Posts Tagged ‘Talend Integration’

Talend tSalesforceOutputBulkExec Component

Salesforce supports cascading update and inserts function by using reference key. In Talend, we can perform the cascading UPSERT function by using tSalesforceOutputBulkExec or tSalesforceOutput components. The benefit of using this function is to reduce the API call from Talend to Salesforce. Imagine the number of calls to make if there are millions of record for data migration.In order…

Read More

Talend: How to use tFileOutputMSDelimited (multi-schema output)

This is a simple guide to show how you can use Talend to generate a complex delimited file (e.g, combination of parent and related child records) by using the tFileOutputMSDelimited component. In this scenario, the sample output that we will be generated is:   Parent Row 1,P1,This is sample description,2013-08-01 Child Row 1,C1,P1 Child Row…

Read More

Talend Tips: Trigger a Job using Socket Listener

We talked about triggering a Talend job by using file listener previously. Today, let’s proceed to the next component which is the tWaitForSocket.   This component utilizes the ServerSocket object in Java to act as a server to listen to a port and trigger the integration process if there is an activity. As you can…

Read More

Talend Tip: Validating XML file with XML Schema (XSD)

All of us know that generating XML data in the integration process is easy, however, generating an XML file that is compliant with the standard of a target application is hard as the data from the source application may be different from the target application. The best practice to prevent sending invalid XML data to…

Read More

Talend Tips: Returning data from Child to Parent process

Sometimes, I prefer to split a very large and complicated logic process into multiple sub-processes and have them executed in sequence. This way, I can manage the process better and make my testing as well as troubleshooting easier. Ever wonder how does the data in such organized process being transmitted from one sub-process to another?…

Read More

Talend Tips: Trigger a Job using File Listener

In Talend, there are 3 useful listener components that we can use to implement an integration process that is being executed/triggered on-demand. The first listener component that we discuss here is tWaitForFile. This component allows you to listen on a file directory and execute an integration process whenever a file is dropped into the directory,…

Read More

Talend: use tSchemaComplianceCheck to validate data

Inserting data from a system to another could be quite troublesome at times especially due to the difference in field length for both systems. However, this can be easily overcome in Talend by utilizing the tSchemaComplianceCheck component. This component can help to validate the data according to the schema that you have defined and it…

Read More

Talend Tips: User Defined Map Function

We have discussed a lot of Talend Integration Studio’s component previously. Today, let’s move on to another interesting tip where we will define our own custom function and use it as a map (User Defined Map Function). In order to create a user-defined map function, first, you will need to create a custom Routine in…

Read More

Talend Tips: Connector lookup in tMap

Are you aware that you can actually do a connector lookup in Talend by using tMap component to retrieve the data? This is very useful as it helps to retrieve the data that you want instead of loading additional unnecessary data into Talend and helps to improve the performance of the Talend job.   I’m…

Read More

Talend Tip: error logging with Apache log4j

In an earlier blog, we explained how to use tLogCatcher to catch errors as they occur in the job and print them to the console. This time, we are going to improve the error logging by utilizing the famous error logging framework from Apache, log4j.   Firstly, you have to create a routine in Talend…

Read More