Uploaded image for project: 'Grouper'
  1. Grouper
  2. GRP-1931

PSPNG - Slow FullSyncs

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Fixed
    • Minor
    • 2.4.0.patch
    • 2.3.0.patch, 2.4.0.patch
    • provisioning
    • None

    Description

      From University of Auckland (auckland.ac.nz)...

      Our PSPNG full sync is very very slow.
      For 6321 groups (150656 memberships), our full sync runs for 50 mins.
      In total, we have 150k+ groups (18mil memberships) which can potentially run a full sync for 2+ days. This is contrasting to the PSPNG statement,
      If grouper-loader.properties has a full-sync schedule, then all the grouper groups which are enabled for provisioning to a target will be queued for reconciliation at the start of that schedule.
      This only takes a short while because the reconciliations occur asynchronously.
      Are there other members of the community you know that uses PSPNG for these many memberships? If yes, how long does it takes for them to run a full sync and how did they optimise it at that speed?

      Attachments

        Activity

          People

            bert.beelindgren@at.internet2.edu Bert Bee-Lindgren
            bert.beelindgren@at.internet2.edu Bert Bee-Lindgren
            Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: