tag:blogger.com,1999:blog-6266231010760265271.post4770810814820702992..comments2024-03-29T01:19:51.547-04:00Comments on Bekwam Blog: Procedural Update in Talend Open StudioCarlhttp://www.blogger.com/profile/15013889141640529637noreply@blogger.comBlogger15125tag:blogger.com,1999:blog-6266231010760265271.post-18823468176894475522012-07-12T11:05:23.981-04:002012-07-12T11:05:23.981-04:00Hi John,
If you're still looking for a Talend...Hi John,<br /><br />If you're still looking for a Talend-only solution to your problem, check out this blog post called "A Theta Join with Talend Open Studio": http://bekwam.blogspot.com/2012/07/theta-join-with-talend-open-studio.html.Carlhttps://www.blogger.com/profile/15013889141640529637noreply@blogger.comtag:blogger.com,1999:blog-6266231010760265271.post-52565155886061126042012-07-11T08:54:13.500-04:002012-07-11T08:54:13.500-04:00thanks for the reply Carl, will work on this using...thanks for the reply Carl, will work on this using the stored proc.<br /><br />thanks again<br />JohnAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-6266231010760265271.post-45026202204739835282012-07-10T22:56:13.922-04:002012-07-10T22:56:13.922-04:00Yep. Load the text file in Oracle, and run a stor...Yep. Load the text file in Oracle, and run a stored procedure. The date processing ("previous event_date") sounds like it won't play to Talend's strengths. However, you can use Talend for the file loading instead of sqlldr. Then call the stored proc from Talend. (See this blog for "stored proc" examples.)Carlhttps://www.blogger.com/profile/15013889141640529637noreply@blogger.comtag:blogger.com,1999:blog-6266231010760265271.post-18741308415306944662012-07-10T22:52:56.369-04:002012-07-10T22:52:56.369-04:00Hi John,
You can do this in Oracle. Sort the inp...Hi John,<br /><br />You can do this in Oracle. Sort the input in the cursor. In a loop, keep track of the "last job_code" in a LOOP. You'll also need to keep track of the "last emp_id" to make sure you're not associating the job_code with the wrong emp.Carlhttps://www.blogger.com/profile/15013889141640529637noreply@blogger.comtag:blogger.com,1999:blog-6266231010760265271.post-69612540025384520522012-07-10T18:39:09.742-04:002012-07-10T18:39:09.742-04:00Hi Carl, Checking to see if you had a chance to lo...Hi Carl, Checking to see if you had a chance to look at the question?<br />thanks<br />JohnAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-6266231010760265271.post-39660671302473822792012-07-09T23:39:14.898-04:002012-07-09T23:39:14.898-04:00Hi Carl, I thought the format will be good, sendin...Hi Carl, I thought the format will be good, sending again with comma separated format<br /><br /><br />Please let me know if the below requirement can be handled in Talend, this is totally a database stuff and I am using oracle.<br /><br />below is the record set I am getting from the source<br /><br />emp_id, job_code, pos_code, acct_code,event_date<br />1, j1, p1, a1, 07/01/12<br />1, null, p1, null, 07/09/12<br /><br />and I want to store in the destination table as shown below<br /><br /><br />emp_id, job_code, pos_code, acct_code,event_date<br />1, j1, p1, a1, 07/01/12<br />1, j1, p1, a1, 07/09/12<br /><br />if any of the code columns is null I want to go and pick the previous value based upon the emp_id and the event_date, I am just giving a simple example, but there are thousands of records from the source with different emp_id's will be having this kind os scenario, I think this can be hanled using some stored proc / script using a cursor, but checking with you to see if this can be handled in Talend.<br /><br />thanks in adavnce. <br /><br />JohnAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-6266231010760265271.post-6795525935210832752012-07-09T23:33:17.452-04:002012-07-09T23:33:17.452-04:00Hi Carl, Please let me know if the below requireme...Hi Carl, Please let me know if the below requirement can be handled in Talend, this is totally a database stuff and I am using oracle.<br /><br />below is the record set I am getting from the source<br /><br />emp_id job_code position_code account_code event_date<br /> 1 j1 p1 a1 07/01/12<br /> 1 null p1 null 07/09/12<br /><br />and I want to store in the destination table as shown below<br /><br /><br />emp_id job_code position_code account_code event_date<br /> 1 j1 p1 a1 07/01/12<br /> 1 j1 p1 a1 07/09/12<br /><br />if any of the code columns is null I want to go and pick the previous value based upon the emp_id and the event_date, I am just giving a simple example, but there are thousands of records from the source with different emp_id's will be having this kind os scenario, I think this can be hanled using some stored proc / script using a cursor, but checking with you to see if this can be handled in Talend.<br /><br />thanks in adavnce. <br /><br />JohnAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-6266231010760265271.post-61465379677711913942011-05-30T16:09:08.735-04:002011-05-30T16:09:08.735-04:00Hi,
Which version of TOS and Excel are you using?...Hi,<br /><br />Which version of TOS and Excel are you using?<br /><br />I added a screenshot in the post's body from a job I wrote in 4.2.1 with Excel 2010 Professional and was able to record the output in Excel across multiple iterations. <br /><br />If you're having difficulties after reviewing the screenshot, see if you can get a simple tLoop -> tRowGenerator -> tFileOutputExcel job working.<br /><br />1. Drag a tLoop, tRowGenerator, and tFileOutputExcel on the canvas.<br />2. Connect the tLoop iterate to the tRowGenerator.<br />3. Configure the tRowGenerator. Add a field using the default values for name and function (getAsciiRandom). Reduce the '100' rows generated to '1'.<br />4. Connect the tRowGenerator's main to the tFileOutputExcel.<br />5. Configure the tFileOutputExcel with a filename, both appends checked, and the desired version (2007).<br /><br />The result should be a 10-row spreadsheet where each iteration -> a new record.Carlhttps://www.blogger.com/profile/15013889141640529637noreply@blogger.comtag:blogger.com,1999:blog-6266231010760265271.post-12158896209525962232011-05-30T15:02:05.783-04:002011-05-30T15:02:05.783-04:00Hi Carl,
I tried with excel. Yes log is generati...Hi Carl,<br /> I tried with excel. Yes log is generating. But only last set of iterating group is getting written to excel. I tied with append option in the sheet also. Still not working. Strange thing is when I am selecting the debug run with traces it shows all the set of records are approaching to excel in the output.<br />Again I tried with access. Input and look up I used a table. Same table I used in output as update option. Nothing is getting updated. Again here also traces showing all records coming perfectly till output access. I have checked update option only. Still the problem persists<br />Sanilcrazyindianhttps://www.blogger.com/profile/04268054300614786349noreply@blogger.comtag:blogger.com,1999:blog-6266231010760265271.post-49858050339325333702011-05-27T12:48:20.559-04:002011-05-27T12:48:20.559-04:00I don't see a Talend option to update with tFi...I don't see a Talend option to update with tFileOutputExcel similar to that used with tAccessOutput. If possible, try to use a database like MS Access or MySQL. <br /><br />If not, then create a second Excel file using tFileOutputExcel. Follow up the processing with a sequence of file operations (tFileCopy) that replace the input Excel file with the output.<br /><br />Good luck. Thanks for the feedback. I'm going to use the video walkthrough in future posts.Carlhttps://www.blogger.com/profile/15013889141640529637noreply@blogger.comtag:blogger.com,1999:blog-6266231010760265271.post-22857050769249626962011-05-27T12:40:22.960-04:002011-05-27T12:40:22.960-04:00Hi Carl,
Your presentation is awesome.Youtube is ...Hi Carl,<br /> Your presentation is awesome.Youtube is so powerful medium.As I am very new to Talend it is really helpful.Also I am planning to go through all your series.<br />I tried to impliment this.It works. But excel is not geeting updated.However I can see output in the logs.To update excel automatically do we need to do any seetinsg changes in update excel file transformation?<br />Sanilcrazyindianhttps://www.blogger.com/profile/04268054300614786349noreply@blogger.comtag:blogger.com,1999:blog-6266231010760265271.post-37336137873825143762011-05-27T08:38:10.389-04:002011-05-27T08:38:10.389-04:00Hi Sanil,
I published a video that walks through ...Hi Sanil,<br /><br />I published a video that walks through an Excel-only job. Look at the end of the original post for the "Excel Input (not Database) Walkthrough" section.Carlhttps://www.blogger.com/profile/15013889141640529637noreply@blogger.comtag:blogger.com,1999:blog-6266231010760265271.post-72003393678760651242011-05-26T17:56:35.197-04:002011-05-26T17:56:35.197-04:00Hi,
The code works .But Output is not as expecte...Hi, <br /> The code works .But Output is not as expected.<br /> Scenario here is my input and output is excel not DB. Second Excel is look up one say cotain only 2 distict recods.Itration happnes for 5 inputs but in outout I am geeting as <br />121 1<br />122 2<br />This mean reset count and mutilpe count for each repetition is not happeningcrazyindianhttps://www.blogger.com/profile/04268054300614786349noreply@blogger.comtag:blogger.com,1999:blog-6266231010760265271.post-14048754138017983052011-05-26T15:44:03.357-04:002011-05-26T15:44:03.357-04:00Thanks for the feedback.
I added the component na...Thanks for the feedback.<br /><br />I added the component names to the main job diagram and included additional screen shots from the Component View window.<br /><br />I'm working on some new video tutorials, so be sure to check out the Bekwam YouTube Channel. The video tutorials are better for those starting out since they aren't as fragmented as the blog posts.Carlhttps://www.blogger.com/profile/15013889141640529637noreply@blogger.comtag:blogger.com,1999:blog-6266231010760265271.post-26098680092066901022011-05-26T14:04:34.153-04:002011-05-26T14:04:34.153-04:00Hi,
Thanks for the post.Kindly consider my feed ...Hi, <br /> Thanks for the post.Kindly consider my feed back<br />1.Please do not rename any of the component as it will be difficult for a newcomer to undertsand the transformation from the figure alone.please add some numbers if you need to use it in description.<br />2.Also please list out screen shots of the content/changes of each components.Else it is difficult to follow unless some one is fully aware of all the features.<br />Sanilcrazyindianhttps://www.blogger.com/profile/04268054300614786349noreply@blogger.com