Parallel-Ready Batch Splitter
Splits a large dataset into N batch files that can be picked up by multiple PAD machines (runners) operating in parallel.
This script is included with FlowLibs Pro
The full PAD script and its setup notes unlock with a Pro or Team plan. Everything else on this page is free to read.
Provided as-is, without warranty of any kind. Review and test each pattern in a non-production environment before deploying it to live automations. See our Terms.
Problem this solves
Single-machine PAD hits throughput limits; need a pattern to fan out work across multiple runners.
Usage Notes
- 1.Two-part design: Patterns 1-4 on orchestrator, Pattern 5 on each worker.
- 2.Shared folder is required for multi-machine execution — use UNC path.
- 3.Lock file pattern prevents race conditions — best-effort lock for most scenarios.
- 4.Ceiling division math uses TruncateNumber since PAD has no native ceiling function.
- 5.Memory: ClearDataTable after each batch keeps memory flat.
Dependencies
- Large Datatable Streamer
- Legacy App Data Entry Loop
- Batch Chunker