Insert / Update DB

Workshop - Insert/Update DB

Steel Wheels needs to update its Employee records as folks join and get promoted.

In this guided Lab, you will:

Insert / Update the Employees Table.

1188,Firrelli,Julianne,x2174,[email protected],2,1143,Sales Manager 1619,King,Tom,x6324,[email protected],6,1088,Sales Rep 1810,Lundberg,Anna,x910,[email protected],2,1143,Sales Rep 1811,Schulz,Chris,x951,[email protected],2,1143,Sales Rep

Create a new Transformation

Any one of these actions opens a new Transformation tab for you to begin designing your transformation.

By clicking File > New > Transformation
By using the CTRL-N hot key

Text file input

The Text File Input step is used to read data from a variety of different text-file types. The most commonly used formats include Comma Separated Values (CSV files) generated by spreadsheets and fixed width flat files.

The Text File Input step provides you with the ability to specify a list of files to read, or a list of directories with wild cards in the form of regular expressions. In addition, you can accept filenames from a previous step making filename handling more even more generic.

Start Pentaho Data Integration.

Windows - PowerShell

Set-Location C:\Pentaho\design-tools\data-integration
.\spoon.bat

Linux

cd
cd ~/Pentaho/design-tools/data-integration
./spoon.sh

Drag the Text File Input step onto the canvas.
Open the Text File properties dialog box.
Ensure the following details are configured, as outlined below:

Because the sample file is located in the same directory where the transformation resides, a good approach to naming the file in a way that is location independent is to use a system variable to parameterize the directory name where the file is located. In our case, the complete filename is:

${Internal.Transformation.Filename.Directory}/employees_insert_update.txt

Click on the ‘Content’ tab and configure the following properties:

Click on ‘Get Fields’ button.
Click on the ‘Fields’ tab and notice the following properties:

Close the step.

RUN

This step is particularly useful for incremental data loads, data synchronization between systems, and scenarios where you need to either create new records or modify existing ones in a single operation without having to use separate update and insert steps.

Click the Run button in the Canvas Toolbar.
Click on the Step Metrics tab:

Notice that the Insert / Update Employees step has written 4 records and updated 2 .. therefore, 2 records have been inserted..!

Check the records in the database.

select * from EMPLOYEES
where EMPLOYEENUMBER in ('1188','1619','1810','1811');

PreviousUpdate DB table NextDelete DB table

Last updated 1 month ago

Was this helpful?

Good evening