Parallel-Ready Batch Splitter
Splits a large dataset into N batch files that can be picked up by multiple PAD machines (runners) operating in parallel.
Sign in or create a free account to copy this script.
Problem this solves
Single-machine PAD hits throughput limits; need a pattern to fan out work across multiple runners.
Usage Notes
- 1.Two-part design: Patterns 1-4 on orchestrator, Pattern 5 on each worker.
- 2.Shared folder is required for multi-machine execution — use UNC path.
- 3.Lock file pattern prevents race conditions — best-effort lock for most scenarios.
- 4.Ceiling division math uses TruncateNumber since PAD has no native ceiling function.
- 5.Memory: ClearDataTable after each batch keeps memory flat.
Dependencies
- Large Datatable Streamer
- Legacy App Data Entry Loop
- Batch Chunker