Featured Post

Applying Email Validation to a JavaFX TextField Using Binding

This example uses the same controller as in a previous post but adds a use case to support email validation.  A Commons Validator object is ...

Sunday, February 27, 2011

[AUDIO] Integration Tools Podcast, Episode 7: SAP. Oracle. Talend. iWay.

Episode 7 of the Integration Tools Podcast is available. The podcast is on integration tools' product releases, research, and events. Episode 7 covers SAP (BusinessObjects),Oracle, Talend, and iWay (Information Builders).

Spend one or two minutes a week to keep on top of the data integration tools market.

Integration Tools Podcast Episode 7

For more podcasts, visit http://www.bekwam.com

Wednesday, February 23, 2011

[TUTORIAL] A MySQL Type 1 Dimension with Talend Open Studio

A Type 1 Dimension is sometimes called Upsert or Overwrite based on its loading characteristics. This tutorial shows how to load a Type 1 Dimension, implemented in MySQL, with Talend Open Studio.

Tuesday, February 22, 2011

Cleaning Data with tReplace in Talend Open Studio

If you need to clean data -- like mapping a source system-specific value to a standardized one -- use the tReplace component in Talend Open Studio.

Saturday, February 19, 2011

[AUDIO] Integration Tools Podcast, Episode 6: SAP. Oracle. Talend. iWay.

Episode 6 of the Integration Tools Podcast is available. The podcast is on integration tools' product releases, research, and events. Episode 6 covers Talend, SAP StreamWork, Oracle AIA, and WhereScape Fast Track.

Spend one or two minutes a week to keep on top of the data integration tools market.

Integration Tools Podcast Episode 6

For more podcasts, visit http://www.bekwam.com

[TUTORIAL] Using Groovy with Talend Open Studio

Use the tGroovy and tGroovyFile components to call a Groovy script from Talend Open Studio. Be sure to check out http://goo.gl/YnBoZ for details on the Groovy script referenced in the video.

A Groovy Script That Uses Dates and Files

Groovy is a flexible scripting languages that's backed by the standard libraries of Java.  A script written in Groovy can use standard Java operators like "+" and libraries like java.util.Date with a slight syntactic difference.

Friday, February 18, 2011

ETL Filter Patterns with Talend Open Studio

When you're writing ETL code in Talend Open Studio, there are a few places you can filter in relation to transformations: before, after, or during.

Tuesday, February 15, 2011

Shorthand Globals for Talend Open Studio

In Talend Open Studio, even with code complete, it's sometimes difficult to work with long strings for reading global variables.  Use a single function 'glstr' to reduce the clutter in your expressions.

Sunday, February 13, 2011

Getting the Source Filename in CloverETL

CloverETL uses a special property of Readers like XLSDataReader to retrieve the data source filename.

[AUDIO] Integration Tools Podcast, Episode 5: Astera Centerprise. Informatica Cloud. Talend Service Factory.

Episode 5 of the Integration Tools Podcast is available. The podcast is on integration tools' product releases, research, and events. Episode 4 covers Astera Centerprise, Informatica Cloud, and Talend Service Factory.

Spend one or two minutes a week to keep on top of the data integration tools market.

Integration Tools Podcast: Episode 5

For more podcasts, visit http://www.bekwam.com

Vendors Covered in Integration Tools Podcast

Visit www.bekwam.com for the Integration Tools Podcast.  The Integration Tools Podcast covers news, events, research, and product announcements for integration tools.

Friday, February 11, 2011

The Talend Open Studio Date Dimension Job

Use Java 1.6's Calendar class to build a rich date dimension using Talend Open Studio.

Wednesday, February 9, 2011

Scripting a Date Dimension Using Talend Open Studio

For a rigorous date dimension, you'll probably need to work with a spreadsheet.  However, if you don't have to integrate business-specific data like holidays, you can use Java's Calendar class in a Talend Open Studio Job to build the dimension.

Monday, February 7, 2011

Running a File of SQL Statements with Talend Open Studio

Read in and execute a file of SQL statements, one per line, into a MySQL database using Talend Open Studio

Sunday, February 6, 2011

[AUDIO] Integration Tools Podcast, Episode 4: Expressor Studio, DataRush 5.0

Episode 4 of the Integration Tools Podcast is available. The podcast is on integration tools' product releases, research, and events. Episode 4 covers Expressor Studio Community Edition and DataRush 5.0.

Spend one or two minutes a week to keep on top of the data integration tools market.

Integration Tools Podcast, Episode 4

For more podcasts, visit http://www.bekwam.com

Saturday, February 5, 2011

[TUTORIAL] Converting Data Types with Talend Open Studio

Use tConvertType's Auto Cast to convert a batch of String fields to a more restrictive data type like Long.

[TUTORIAL] A Quick Report with Talend Open Studio

No sooner do you create an application or build a data warehouse, then people are pulling your data out. Talend Open Studio has a quick way to create a report.

Friday, February 4, 2011

User Defined Functions with Talend Open Studio

You can call any Java function from Talend Open Studio, but if you register that function as a Routine, there are several benefits.

SYSDATE in Talend Open Studio

You can set dates in Talend Open Studio using Java, MySQL functions, SQL functions, Talend functions, or user-defined functions.

Wednesday, February 2, 2011

A Quick Report with Talend Open Studio

If you don't have Jasper around, you can create a report or an extract with extra headers or text using the a tForeach and a tIterateToFlow.

Staging Data for ETL Processing with Talend Open Studio

For loading a set of files into a staging table with Talend Open Studio, use two subjobs: one subjob for clearing the tables for the overall job and one subjob for iterating over the files and loading each one.

Tuesday, February 1, 2011

Excel Workbook Processing with Talend Open Studio

To process Excel files in a loop that iterates over a set of files and the sheets within the files, use the tFileList and tFileInputExcel components along with a few global variables.