Forum Discussion

KurtMayer's avatar
KurtMayer
Contributor
8 months ago

Is there guidance on the setting for the number of parallel executions for Harvest Batch Loads?

When using the BRAPi.Utilities.ExecuteFileHarvestBatchParallel function in an Extender BR, does anyone have any guidance and/or opinions on the proper setting of the parallelBatchCount parameter? 

My understanding has always been to set it to a maximum of the number of CPUs - 1 , available for the server performing data management or batch load processing.

  • KH1's avatar
    KH1
    Contributor III
    8 months ago

    Please review our findings below:
    1. Raise a Case
    - Max Parallelism = the number of Servers' CPU Cores

    Max Parallelism = the number of CPU Cores (32 Cores for our Servers)

    2. Trial and Error
    Run: parallelBatchCount = 16, 18, 20, 22, 24, etc.
    - Our tests showed that jobs ran longer when parallelBatchCount >= 20.