[SalesForce] SOAP API Request with body larger than 16 Kilobytes results in Timeout Exception

I stumbled upon an interesting limitation, it seems that SOAP API endpoint handles requests larger than 16Kb differently — whenever body is larger than that request just times out.

We're using 'create' SOAP request to create sObjects. The main reason we're using SOAP is its ability to batch up-to 200 sObjects into one call while still being synchronous (comparing to Bulk API).

When I tried to increase HTTP read/open timeout, then after waiting for 10 minutes or so (a '<= 16KB request' takes just a second), I've received once a response about invalid XML: "Content is not allowed in trailing section.".

Interestingly, I've noticed this behavior for 'Notes' sObject, for 'Attachments' requests larger than 16Kb were handled correctly!

Has someone seen something like that? How does this works together with a 200 objects API limit?

Update: I've tried this on 2 different instances: one is Developer Edition and the other is Professional Edition with enabled API. Could that be the issue?

Just to eliminate any library specifics (I am on Ruby with Savon SOAP library) I tried making a simple post request with body as the same XML/SOAP message and with body size less than 16Kb — I received some warning about ContentType, but as soon as I hit 16Kb + 1 byte, I started receiving Timeouts.

Update 2: Tried posting big response ~64Kb (several Note objects) with cURL and it actually worked. I will dig deeper, seems like it might be a Ruby specific issue (or something stupid I am (not) doing).

Update 3: This is strange and stupid, but now everything works like a charm. And what worries me, that I haven't changed anything.

Thanks, everybody for help: you gave me ideas how to try making those requests differently.

Update 4: Next day I started to get Timeouts again. I immediately checked if the same request works with cURL and it did. So, I just replaced usage of Ruby stdlib net/http to curb and voila — no more timeouts.

Quick googling didn't yield any results if this is a known issue. Probably, it is a combination of the way Salesforce SOAP API endpoint responds and some bug in Ruby stdlib (or misconfiguration on my side).

Best Answer

Replacing Ruby stdlib net/http to curb solved this problem for me.

Related Solutions

[SalesForce] SOAP API – No operation available for request

You have a typo in the xml namespace, you have

xmlns:urn="urn:parner.soap.sforce.com"

it should be

xmlns:urn="urn:partner.soap.sforce.com"

[SalesForce] How to make signed request to Salesforce using an Access token and SOAP api

The OAuth 2.0 response includes the id property, which is a URL for the Identity Service, with the format

https://login.salesforce.com/id/[ORG_ID]/[USER_ID]

Invoke this URL with the access token, and you'll receive a JSON object with a bunch of useful data including the Partner API server URL. I don't have a Python example handy, but here's an example using command-line curl. Note the -L parameter - you need to follow the redirect, and the version=latest query parameter just says you want the latest API version URLs:

$ curl -L -H 'Authorization: Bearer 00DE0000000HegH!AREAQBXmi3kZkq.14qNdqVUAhdmdj8jCvSnZhsdDck.xhFwoaxUdgG6fiqY3OKebwLQoRnSudnpNHsrC30xaqk8R8ZRX1eJS' -H 'X-PrettyPrint: 1' https://login.salesforce.com/id/00DE0000000HegHMAS/005E0000000HiFiIAK?version=latest
{
  "id" : "https://login.salesforce.com/id/00DE0000000HegHMAS/005E0000000HiFiIAK",
  "asserted_user" : true,
  "user_id" : "005E0000000HiFiIAK",
  "organization_id" : "00DE0000000HegHMAS",
  "username" : "pat@devorg.com",
  "nick_name" : "pat1.2979659540664607E12",
  "display_name" : "Pat Patterson",
  "email" : "ppatterson@salesforce.com",
  "first_name" : "Pat",
  "last_name" : "Patterson",
  "status" : {
    "created_date" : null,
    "body" : null
  },
  "photos" : {
    "picture" : "https://devorg-com-dev-ed--c.na9.content.force.com/profilephoto/729E0000000Ubc9/F",
    "thumbnail" : "https://devorg-com-dev-ed--c.na9.content.force.com/profilephoto/729E0000000Ubc9/T"
  },
  "urls" : {
    "enterprise" : "https://devorg-com-dev-ed.my.salesforce.com/services/Soap/c/29.0/00DE0000000HegH",
    "metadata" : "https://devorg-com-dev-ed.my.salesforce.com/services/Soap/m/29.0/00DE0000000HegH",
    "partner" : "https://devorg-com-dev-ed.my.salesforce.com/services/Soap/u/29.0/00DE0000000HegH",
    "rest" : "https://devorg-com-dev-ed.my.salesforce.com/services/data/v29.0/",
    "sobjects" : "https://devorg-com-dev-ed.my.salesforce.com/services/data/v29.0/sobjects/",
    "search" : "https://devorg-com-dev-ed.my.salesforce.com/services/data/v29.0/search/",
    "query" : "https://devorg-com-dev-ed.my.salesforce.com/services/data/v29.0/query/",
    "recent" : "https://devorg-com-dev-ed.my.salesforce.com/services/data/v29.0/recent/",
    "profile" : "https://devorg-com-dev-ed.my.salesforce.com/005E0000000HiFiIAK",
    "feeds" : "https://devorg-com-dev-ed.my.salesforce.com/services/data/v29.0/chatter/feeds",
    "groups" : "https://devorg-com-dev-ed.my.salesforce.com/services/data/v29.0/chatter/groups",
    "users" : "https://devorg-com-dev-ed.my.salesforce.com/services/data/v29.0/chatter/users",
    "feed_items" : "https://devorg-com-dev-ed.my.salesforce.com/services/data/v29.0/chatter/feed-items",
    "custom_domain" : "https://devorg-com-dev-ed.my.salesforce.com"
  },
  "active" : true,
  "user_type" : "STANDARD",
  "language" : "en_US",
  "locale" : "en_US",
  "utcOffset" : -28800000,
  "last_modified_date" : "2013-06-19T17:19:41.000+0000"
}

The URL you are looking for is urls.partner, which is https://devorg-com-dev-ed.my.salesforce.com/services/Soap/u/29.0/00DE0000000HegH in the above example.

Best Answer

Related Solutions

[SalesForce] SOAP API – No operation available for request

[SalesForce] How to make signed request to Salesforce using an Access token and SOAP api

Related Topic