I am currently using Bulk API 2.0 to insert, update and delete data in Salesforce.
What I am confused about is uploading more than 1 batch of CSV records to a job before it is closed?
I create a Bulk API 2 job, I can then upload to that job once, but I cannot upload a second batch of data to the same job id. The examples do not show a second batch of data being uploaded to the same job id but the REST API suggests it can be done by :
- having a URL that ends with the word batches and not batch singular i.e. services/data/v44.0/jobs/ingest/jobid/batches
- having a separate PATCH (for URL services/data/v44.0/jobs/ingest/jobid) method to mark the job as complete. If you weren't expecting more batches of CSV data to be uploaded why not mark the job as complete automatically and dispense with this API call.
Is it possible to upload multiple batches to the same Job ID?
Best Answer
I saw a Bulk API 2.0 presentation at TrailheaDX where this came up... I think it's a no, Bulk 2.0 is designed to ingest one data file and then start processing. Recall though that the limits on Bulk 2.0 are by volume of records not number of batches.
If you weren't expecting more batches of CSV data to be uploaded why not mark the job as complete automatically and dispense with this API call.
One possible reason is, networks can be unreliable. A disruption in the transfer could create a state where, for example, the client believes the transfer was incomplete because it didn't receive an acknowledgement packet, but in fact the server did receive the file. If it got marked as complete automatically, it would start processing even though the client thought it had failed.