I am currently designing a solution which will likely include upload (insert/upsert) of 1000s of records per upload. I am doing some calculations to evaluate how far the solution might be from hitting governor limits as the upload will make some triggers fire directly and indirectly (via RollUps summary fields). Your input will be appreciated.
Use case: uploading (insert/upsert) 1000s records via data loader. Not using Bulk API. Batch size in data loader set to 100.
Is each batch a discrete operation/transaction? If so, I believe governor limits apply to each batch/operation rather than to the whole upload?
Best Answer
Yes, each batch has its own limits and each batch consumes an API call, they are unrelated to one another.
Reduce the batch size if you hit governor limits, this will of course increase the time it takes to process them.
You might find this useful for understanding the impact of that: http://limitexception.herod.net/2011/12/15/talend-vs-apex-dataloader-bulk-uploaddownload-benchmarks/