Batches under Bulk API jobs salesforce

So I think the problem is that the bulk data API is running multiple asynchronous batches and thus kicking off too many Batchable Contexts.

It looks like your batch process doesn't actually care what Id's you pass in and instead just processes everything?

If this is the case and you don't need real time (or close to realtime) updates, it might be a better idea to just schedule this to run.

Otherwise, if you need it to happen in near real time, you could use batch "chaining" in order the have the batch keep running as long as there are records to process.

The basic steps would look something like this:

1. In the finish method, add a check to see if there are more records to process. If so kick off another batch.
2. In your trigger, have it first check if the batch is already running. If so, you don't need to do anything. Otherwise, have it kick off the batch.

Update

If you have access to the JobInfo concurrencyMode param, you can set this to "Serial" and it will prevent multiple batches from running in parallel. I think this might solve you problem. If that alone doesn't work, try also reducing the batch size. Obviously, this will cause the import to take much (much) longer.

On the dataloader this Serial can be turned on by checking "Enable Serial Mode for Bulk Api".

Whether they will run parallel or not is something that will be beyond your control. The general answer is that it is not likely for that to happen. The reason for that is because of how queued asynchronous jobs are processed in a pod. Rather than repeat that explanation here, I'm going to refer you to my answer to Dramatic increase in AsyncApexJob latency which explains how queued jobs are processed in a pod. The summary being that more jobs you have queued, the larger delays you can expect to occur between processing of your jobs.