camel-salesforce-kafka-connector sink configuration
Connector Description: Communicate with Salesforce using Java DTOs.
When using camel-salesforce-kafka-connector as sink make sure to use the following Maven dependency to have support for the connector:
<dependency>
<groupId>org.apache.camel.kafkaconnector</groupId>
<artifactId>camel-salesforce-kafka-connector</artifactId>
<version>x.x.x</version>
<!-- use the same version as your Camel Kafka connector version -->
</dependency>
To use this sink connector in Kafka connect you’ll need to set the following connector.class
connector.class=org.apache.camel.kafkaconnector.salesforce.CamelSalesforceSinkConnector
The camel-salesforce sink connector supports 136 options, which are listed below.
Name | Description | Default | Priority |
---|---|---|---|
The operation to use One of: [getVersions] [getResources] [getGlobalObjects] [getBasicInfo] [getDescription] [getSObject] [createSObject] [updateSObject] [deleteSObject] [getSObjectWithId] [upsertSObject] [deleteSObjectWithId] [getBlobField] [query] [queryMore] [queryAll] [search] [apexCall] [recent] [createJob] [getJob] [closeJob] [abortJob] [createBatch] [getBatch] [getAllBatches] [getRequest] [getResults] [createBatchQuery] [getQueryResultIds] [getQueryResult] [getRecentReports] [getReportDescription] [executeSyncReport] [executeAsyncReport] [getReportInstances] [getReportResults] [limits] [approval] [approvals] [composite-tree] [composite-batch] [composite] [compositeRetrieveSObjectCollections] [compositeCreateSObjectCollections] [compositeUpdateSObjectCollections] [compositeUpsertSObjectCollections] [compositeDeleteSObjectCollections] [bulk2GetAllJobs] [bulk2CreateJob] [bulk2GetJob] [bulk2CreateBatch] [bulk2CloseJob] [bulk2AbortJob] [bulk2DeleteJob] [bulk2GetSuccessfulResults] [bulk2GetFailedResults] [bulk2GetUnprocessedRecords] [bulk2CreateQueryJob] [bulk2GetQueryJob] [bulk2GetAllQueryJobs] [bulk2GetQueryJobResults] [bulk2AbortQueryJob] [bulk2DeleteQueryJob] [raw]. Enum values:
|
MEDIUM |
||
APEX method name. |
MEDIUM |
||
Query params for APEX method. |
MEDIUM |
||
Salesforce API version. |
"50.0" |
MEDIUM |
|
Backoff interval increment for Streaming connection restart attempts for failures beyond CometD auto-reconnect. |
1000L |
MEDIUM |
|
Bulk API Batch ID. |
MEDIUM |
||
Bulk API content type, one of XML, CSV, ZIP_XML, ZIP_CSV One of: [XML] [CSV] [JSON] [ZIP_XML] [ZIP_CSV] [ZIP_JSON]. Enum values:
|
MEDIUM |
||
Default replayId setting if no value is found in initialReplayIdMap. |
"-1" |
MEDIUM |
|
Payload format to use for Salesforce API calls, either JSON or XML, defaults to JSON One of: [JSON] [XML]. Enum values:
|
MEDIUM |
||
Custom Jetty Http Client to use to connect to Salesforce. |
MEDIUM |
||
Include details in Salesforce1 Analytics report, defaults to false. |
MEDIUM |
||
Replay IDs to start from per channel name. |
MEDIUM |
||
Salesforce1 Analytics report execution instance ID. |
MEDIUM |
||
Bulk API Job ID. |
MEDIUM |
||
Limit on number of returned records. Applicable to some of the API, check the Salesforce documentation. |
MEDIUM |
||
Maximum backoff interval for Streaming connection restart attempts for failures beyond CometD auto-reconnect. |
30000L |
MEDIUM |
|
Sets the behaviour of 404 not found status received from Salesforce API. Should the body be set to NULL NotFoundBehaviour#NULL or should a exception be signaled on the exchange NotFoundBehaviour#EXCEPTION - the default. One of: [EXCEPTION] [NULL]. Enum values:
|
"EXCEPTION" |
MEDIUM |
|
Notify for fields, options are ALL, REFERENCED, SELECT, WHERE One of: [ALL] [REFERENCED] [SELECT] [WHERE]. Enum values:
|
MEDIUM |
||
Notify for create operation, defaults to false (API version = 29.0). |
MEDIUM |
||
Notify for delete operation, defaults to false (API version = 29.0). |
MEDIUM |
||
Notify for operations, options are ALL, CREATE, EXTENDED, UPDATE (API version 29.0) One of: [ALL] [CREATE] [EXTENDED] [UPDATE]. Enum values:
|
MEDIUM |
||
Notify for un-delete operation, defaults to false (API version = 29.0). |
MEDIUM |
||
Notify for update operation, defaults to false (API version = 29.0). |
MEDIUM |
||
Custom Jackson ObjectMapper to use when serializing/deserializing Salesforce objects. |
MEDIUM |
||
Use PK Chunking. Only for use in original Bulk API. Bulk 2.0 API performs PK chunking automatically, if necessary. |
MEDIUM |
||
Chunk size for use with PK Chunking. If unspecified, salesforce default is 100,000. Maximum size is 250,000. |
MEDIUM |
||
Specifies the parent object when you’re enabling PK chunking for queries on sharing objects. The chunks are based on the parent object’s records rather than the sharing object’s records. For example, when querying on AccountShare, specify Account as the parent object. PK chunking is supported for sharing objects as long as the parent object is supported. |
MEDIUM |
||
Specifies the 15-character or 18-character record ID to be used as the lower boundary for the first chunk. Use this parameter to specify a starting ID when restarting a job that failed between batches. |
MEDIUM |
||
Query Locator provided by salesforce for use when a query results in more records than can be retrieved in a single call. Use this value in a subsequent call to retrieve additional records. |
MEDIUM |
||
Use raw payload String for request and response (either JSON or XML depending on format), instead of DTOs, false by default. |
false |
MEDIUM |
|
Salesforce1 Analytics report Id. |
MEDIUM |
||
Salesforce1 Analytics report metadata for filtering. |
MEDIUM |
||
Bulk API Result ID. |
MEDIUM |
||
SObject blob field name. |
MEDIUM |
||
Fully qualified SObject class name, usually generated using camel-salesforce-maven-plugin. |
MEDIUM |
||
SObject fields to retrieve. |
MEDIUM |
||
SObject ID if required by API. |
MEDIUM |
||
SObject external ID field name. |
MEDIUM |
||
SObject external ID field value. |
MEDIUM |
||
SObject name if required or supported by API. |
MEDIUM |
||
Salesforce SOQL query string. |
MEDIUM |
||
Salesforce SOSL search string. |
MEDIUM |
||
Whether to update an existing Push Topic when using the Streaming API, defaults to false. |
false |
MEDIUM |
|
Composite API option to indicate to rollback all records if any are not successful. |
false |
MEDIUM |
|
APEX method URL. |
MEDIUM |
||
Composite (raw) method. |
MEDIUM |
||
Whether the producer should be started lazy (on the first message). By starting lazy you can use this to allow CamelContext and routes to startup in situations where a producer may otherwise fail during starting and cause the route to fail being started. By deferring this startup to be lazy then the startup failure can be handled during routing messages via Camel’s routing error handlers. Beware that when the first message is processed then creating and starting the producer may take a little time and prolong the total processing time of the processing. |
false |
MEDIUM |
|
Comma separated list of message headers to include as HTTP parameters for Raw operation. |
MEDIUM |
||
HTTP method to use for the Raw operation. |
MEDIUM |
||
The portion of the endpoint URL after the domain name. E.g., '/services/data/v52.0/sobjects/Account/'. |
MEDIUM |
||
Comma separated list of message headers to include as query parameters for Raw operation. Do not url-encode values as this will be done automatically. |
MEDIUM |
||
APEX method name. |
MEDIUM |
||
Query params for APEX method. |
MEDIUM |
||
Salesforce API version. |
"50.0" |
MEDIUM |
|
Backoff interval increment for Streaming connection restart attempts for failures beyond CometD auto-reconnect. |
1000L |
MEDIUM |
|
Bulk API Batch ID. |
MEDIUM |
||
Bulk API content type, one of XML, CSV, ZIP_XML, ZIP_CSV One of: [XML] [CSV] [JSON] [ZIP_XML] [ZIP_CSV] [ZIP_JSON]. Enum values:
|
MEDIUM |
||
Default replayId setting if no value is found in initialReplayIdMap. |
"-1" |
MEDIUM |
|
Payload format to use for Salesforce API calls, either JSON or XML, defaults to JSON One of: [JSON] [XML]. Enum values:
|
MEDIUM |
||
Custom Jetty Http Client to use to connect to Salesforce. |
MEDIUM |
||
Connection timeout used by the HttpClient when connecting to the Salesforce server. |
60000L |
MEDIUM |
|
Timeout used by the HttpClient when waiting for response from the Salesforce server. |
10000L |
MEDIUM |
|
Max content length of an HTTP response. |
MEDIUM |
||
HTTP request buffer size. May need to be increased for large SOQL queries. |
"8192" |
MEDIUM |
|
Include details in Salesforce1 Analytics report, defaults to false. |
MEDIUM |
||
Replay IDs to start from per channel name. |
MEDIUM |
||
Salesforce1 Analytics report execution instance ID. |
MEDIUM |
||
Bulk API Job ID. |
MEDIUM |
||
Limit on number of returned records. Applicable to some of the API, check the Salesforce documentation. |
MEDIUM |
||
Maximum backoff interval for Streaming connection restart attempts for failures beyond CometD auto-reconnect. |
30000L |
MEDIUM |
|
Sets the behaviour of 404 not found status received from Salesforce API. Should the body be set to NULL NotFoundBehaviour#NULL or should a exception be signaled on the exchange NotFoundBehaviour#EXCEPTION - the default. One of: [EXCEPTION] [NULL]. Enum values:
|
"EXCEPTION" |
MEDIUM |
|
Notify for fields, options are ALL, REFERENCED, SELECT, WHERE One of: [ALL] [REFERENCED] [SELECT] [WHERE]. Enum values:
|
MEDIUM |
||
Notify for create operation, defaults to false (API version = 29.0). |
MEDIUM |
||
Notify for delete operation, defaults to false (API version = 29.0). |
MEDIUM |
||
Notify for operations, options are ALL, CREATE, EXTENDED, UPDATE (API version 29.0) One of: [ALL] [CREATE] [EXTENDED] [UPDATE]. Enum values:
|
MEDIUM |
||
Notify for un-delete operation, defaults to false (API version = 29.0). |
MEDIUM |
||
Notify for update operation, defaults to false (API version = 29.0). |
MEDIUM |
||
Custom Jackson ObjectMapper to use when serializing/deserializing Salesforce objects. |
MEDIUM |
||
In what packages are the generated DTO classes. Typically the classes would be generated using camel-salesforce-maven-plugin. This must be set if using the XML format. Also, set it if using the generated DTOs to gain the benefit of using short SObject names in parameters/header values. Multiple packages can be separated by comma. |
MEDIUM |
||
Use PK Chunking. Only for use in original Bulk API. Bulk 2.0 API performs PK chunking automatically, if necessary. |
MEDIUM |
||
Chunk size for use with PK Chunking. If unspecified, salesforce default is 100,000. Maximum size is 250,000. |
MEDIUM |
||
Specifies the parent object when you’re enabling PK chunking for queries on sharing objects. The chunks are based on the parent object’s records rather than the sharing object’s records. For example, when querying on AccountShare, specify Account as the parent object. PK chunking is supported for sharing objects as long as the parent object is supported. |
MEDIUM |
||
Specifies the 15-character or 18-character record ID to be used as the lower boundary for the first chunk. Use this parameter to specify a starting ID when restarting a job that failed between batches. |
MEDIUM |
||
Query Locator provided by salesforce for use when a query results in more records than can be retrieved in a single call. Use this value in a subsequent call to retrieve additional records. |
MEDIUM |
||
Use raw payload String for request and response (either JSON or XML depending on format), instead of DTOs, false by default. |
false |
MEDIUM |
|
Salesforce1 Analytics report Id. |
MEDIUM |
||
Salesforce1 Analytics report metadata for filtering. |
MEDIUM |
||
Bulk API Result ID. |
MEDIUM |
||
SObject blob field name. |
MEDIUM |
||
Fully qualified SObject class name, usually generated using camel-salesforce-maven-plugin. |
MEDIUM |
||
SObject fields to retrieve. |
MEDIUM |
||
SObject ID if required by API. |
MEDIUM |
||
SObject external ID field name. |
MEDIUM |
||
SObject external ID field value. |
MEDIUM |
||
SObject name if required or supported by API. |
MEDIUM |
||
Salesforce SOQL query string. |
MEDIUM |
||
Salesforce SOSL search string. |
MEDIUM |
||
Whether to update an existing Push Topic when using the Streaming API, defaults to false. |
false |
MEDIUM |
|
Global endpoint configuration - use to set values that are common to all endpoints. |
MEDIUM |
||
Used to set any properties that can be configured on the underlying HTTP client. Have a look at properties of SalesforceHttpClient and the Jetty HttpClient for all available options. |
MEDIUM |
||
Used to set any properties that can be configured on the LongPollingTransport used by the BayeuxClient (CometD) used by the streaming api. |
MEDIUM |
||
Maximum size of the thread pool used to handle HTTP responses. |
20 |
MEDIUM |
|
Size of the thread pool used to handle HTTP responses. |
10 |
MEDIUM |
|
Composite API option to indicate to rollback all records if any are not successful. |
false |
MEDIUM |
|
APEX method URL. |
MEDIUM |
||
Composite (raw) method. |
MEDIUM |
||
Whether the producer should be started lazy (on the first message). By starting lazy you can use this to allow CamelContext and routes to startup in situations where a producer may otherwise fail during starting and cause the route to fail being started. By deferring this startup to be lazy then the startup failure can be handled during routing messages via Camel’s routing error handlers. Beware that when the first message is processed then creating and starting the producer may take a little time and prolong the total processing time of the processing. |
false |
MEDIUM |
|
Comma separated list of message headers to include as HTTP parameters for Raw operation. |
MEDIUM |
||
HTTP method to use for the Raw operation. |
MEDIUM |
||
The portion of the endpoint URL after the domain name. E.g., '/services/data/v52.0/sobjects/Account/'. |
MEDIUM |
||
Comma separated list of message headers to include as query parameters for Raw operation. Do not url-encode values as this will be done automatically. |
MEDIUM |
||
Whether autowiring is enabled. This is used for automatic autowiring options (the option must be marked as autowired) by looking up in the registry to find if there is a single instance of matching type, which then gets configured on the component. This can be used for automatic configuring JDBC data sources, JMS connection factories, AWS Clients, etc. |
true |
MEDIUM |
|
A list of addresses for which HTTP proxy server should not be used. |
MEDIUM |
||
Hostname of the HTTP proxy server to use. |
MEDIUM |
||
A list of addresses for which HTTP proxy server should be used. |
MEDIUM |
||
Port number of the HTTP proxy server to use. |
MEDIUM |
||
If set to true the configures the HTTP proxy to use as a SOCKS4 proxy. |
false |
MEDIUM |
|
Explicit authentication method to be used, one of USERNAME_PASSWORD, REFRESH_TOKEN or JWT. Salesforce component can auto-determine the authentication method to use from the properties set, set this property to eliminate any ambiguity. One of: [USERNAME_PASSWORD] [REFRESH_TOKEN] [JWT]. Enum values:
|
MEDIUM |
||
Required OAuth Consumer Key of the connected app configured in the Salesforce instance setup. Typically a connected app needs to be configured but one can be provided by installing a package. |
HIGH |
||
OAuth Consumer Secret of the connected app configured in the Salesforce instance setup. |
MEDIUM |
||
Used in authentication against the HTTP proxy server, needs to match the URI of the proxy server in order for the httpProxyUsername and httpProxyPassword to be used for authentication. |
MEDIUM |
||
Password to use to authenticate against the HTTP proxy server. |
MEDIUM |
||
Realm of the proxy server, used in preemptive Basic/Digest authentication methods against the HTTP proxy server. |
MEDIUM |
||
If set to false disables the use of TLS when accessing the HTTP proxy. |
true |
MEDIUM |
|
If set to true Digest authentication will be used when authenticating to the HTTP proxy, otherwise Basic authorization method will be used. |
false |
MEDIUM |
|
Username to use to authenticate against the HTTP proxy server. |
MEDIUM |
||
URL of the Salesforce instance used after authentication, by default received from Salesforce on successful authentication. |
MEDIUM |
||
KeyStore parameters to use in OAuth JWT flow. The KeyStore should contain only one entry with private key and certificate. Salesforce does not verify the certificate chain, so this can easily be a selfsigned certificate. Make sure that you upload the certificate to the corresponding connected app. |
MEDIUM |
||
If set to true prevents the component from authenticating to Salesforce with the start of the component. You would generally set this to the (default) false and authenticate early and be immediately aware of any authentication issues. |
false |
MEDIUM |
|
All authentication configuration in one nested bean, all properties set there can be set directly on the component as well. |
MEDIUM |
||
Required URL of the Salesforce instance used for authentication, by default set to https://login.salesforce.com. |
"https://login.salesforce.com" |
HIGH |
|
Password used in OAuth flow to gain access to access token. It’s easy to get started with password OAuth flow, but in general one should avoid it as it is deemed less secure than other flows. Make sure that you append security token to the end of the password if using one. |
MEDIUM |
||
Refresh token already obtained in the refresh token OAuth flow. One needs to setup a web application and configure a callback URL to receive the refresh token, or configure using the builtin callback at https://login.salesforce.com/services/oauth2/success or https://test.salesforce.com/services/oauth2/success and then retrive the refresh_token from the URL at the end of the flow. Note that in development organizations Salesforce allows hosting the callback web application at localhost. |
MEDIUM |
||
SSL parameters to use, see SSLContextParameters class for all available options. |
MEDIUM |
||
Enable usage of global SSL context parameters. |
false |
MEDIUM |
|
Username used in OAuth flow to gain access to access token. It’s easy to get started with password OAuth flow, but in general one should avoid it as it is deemed less secure than other flows. |
MEDIUM |
The camel-salesforce sink connector has no converters out of the box.
The camel-salesforce sink connector has no transforms out of the box.
The camel-salesforce sink connector has no aggregation strategies out of the box.