Banking Domain Client :-
---------------------------
My client is ABSA, it an south african company called Barclay. We work on customer data and Employee data.
Employee Data :
If any employees resigns or joins or salary increments or transfers to other department , then the Employee data changes.
So we update the Employee dimension target tables with SCD II techniques.
We load the fact tables after loading dimension tables.
Facts & Dimension Involved are :
Date_Dim, State_Dim, Country_Dim, AccountType_Dim, Company_Dim, Currency_Dim, Bank_Dim
Balance_Fact, AccountID_Fact, CompanyID_Fact, BankID_Fact, CountryID_Fact
Roles and responsibilities in your project :-
---------------------------------------
1) Data we get will be in the format of flat files, sql or oracle.
- We perform change data capture mappings with mapping variable, whenever there is timestamp transactions.
- Sometimes we follow Incremental Aggregation logic, when we have incremental data.
- We follow Indirect meathods, when we have multiple flat files.
- We follow 'configure concurrent workflow' logic, when new flat files arrives now and then.
- We also do partitions ?
2) I work on mapping code errors and reply to them as problem is resolved.
- Connection problems like source database change, we correct it in parameter files.
- Workflow running for long time, we follow performance tuning techniques.
- Suddenly Code has stopped working, we check the complete mapping code and correct it.
- We use debugger to debug a mapping code.
3) We update dimensions when ever there is requirement, mostly the requirement will be on the end of every month.
- Using cust_key suggorate key into the target
- Using Md5 function
- Using dynamic lookup
4) I perform Error Handling techniques to ensure no data is missing.
-
5) I perform Performance tuning if the session is taking long time.
6) We execute workflow on unix with wrapper script
(pmcmd startworkflow -sv <Integration Service Name> -d <Domain Name> -u <Integration Service Username> -p <Password> -f <Folder Name> <Workflow>)
7) We schedule jobs and monitor jobs in tivoli workload scheduler.
---------------------------
My client is ABSA, it an south african company called Barclay. We work on customer data and Employee data.
Employee Data :
If any employees resigns or joins or salary increments or transfers to other department , then the Employee data changes.
So we update the Employee dimension target tables with SCD II techniques.
We load the fact tables after loading dimension tables.
Facts & Dimension Involved are :
Date_Dim, State_Dim, Country_Dim, AccountType_Dim, Company_Dim, Currency_Dim, Bank_Dim
Balance_Fact, AccountID_Fact, CompanyID_Fact, BankID_Fact, CountryID_Fact
Roles and responsibilities in your project :-
---------------------------------------
1) Data we get will be in the format of flat files, sql or oracle.
- We perform change data capture mappings with mapping variable, whenever there is timestamp transactions.
- Sometimes we follow Incremental Aggregation logic, when we have incremental data.
- We follow Indirect meathods, when we have multiple flat files.
- We follow 'configure concurrent workflow' logic, when new flat files arrives now and then.
- We also do partitions ?
2) I work on mapping code errors and reply to them as problem is resolved.
- Connection problems like source database change, we correct it in parameter files.
- Workflow running for long time, we follow performance tuning techniques.
- Suddenly Code has stopped working, we check the complete mapping code and correct it.
- We use debugger to debug a mapping code.
3) We update dimensions when ever there is requirement, mostly the requirement will be on the end of every month.
- Using cust_key suggorate key into the target
- Using Md5 function
- Using dynamic lookup
4) I perform Error Handling techniques to ensure no data is missing.
-
5) I perform Performance tuning if the session is taking long time.
6) We execute workflow on unix with wrapper script
(pmcmd startworkflow -sv <Integration Service Name> -d <Domain Name> -u <Integration Service Username> -p <Password> -f <Folder Name> <Workflow>)
7) We schedule jobs and monitor jobs in tivoli workload scheduler.
No comments:
Post a Comment