APP+0
Adaptive Driver-Agnostic Bulk Indexing
A mass reindex (scout:import) writes to the search engine in adaptive batches instead of one document per job, and embeds a whole chunk in one batched pass, so a weak or fragile server converges to small batches and a strong one to large, without per-server tuning.
Tasks.
- Task 1: The agnostic controller3/3
- Task 2: Bulk search path6/6
- Task 3: Batched embedding pre-process3/3
- Task 4: N+1 follow-up found by measuring a real import3/3
- Task 5: Documentation and close3/3