Merging flows from different csv files.

RasputinJones · **Joined:** Wed Jun 02, 2010 5:20 am **Posts:** 2

Hi I'm trying to merge flows from different CSV files that look like this...

CSV_A
-----

Code:

Titles: Foo, Bar, Baz, Etch, Meh
Rows: 1, , , , 6

CSV_B
-----

Code:

Titles: Foo, Bar, Baz, Etch, Meh
ROws: 1, 2, ,4, ,

CSV_C
-----

Code:

Titles: Foo, Bar, Baz, Etch, Meh
Rows, 1, , 3, , 5,

Desired Output

Code:

Titles: Foo, Bar, Baz, Etch, Meh
Rows: 1, 2, 3, 4, 5, 6

How would one go about this with Clover? What component or component(s) to use?

Thanks,

Rasputin.

avackova · **Joined:** Fri Jul 20, 2007 9:28 am **Posts:** 550

Hello,
I see two scenarios to achieve the aim:

DataReader --> ExtSort --> Denormalizer - Data Reader reads all the files using wild-cards, if the key doesn't exist it can be created by source_row_count auto filling function
Data Readers ==> MergeJoin - each reader reads its own file, key can be also generated by source_row_count or global_row_count auto filling function

RasputinJones · **Joined:** Wed Jun 02, 2010 5:20 am **Posts:** 2

Right on! Went with the denormalize option.

CloverETL is so righteous...!!!

CloverETL Forum