RoboCon 2024

Harnessing the POWER of Robot Framework for Automation Of Data Quality Controls
2024-02-28 , RoboConOnline

In this presentation we will go over a live use case showcasing the power of Robot Framework and it is usage in the Automation of Data Quality Controls.


We live in a World of Data. We need data for almost every Analytical purpose. Financial institutions are one among the Major sectors using Data especially
in Trade and investment, Tax reform, Fraud detection and Investigation and Risk Analysis.

We will have quick overview of a live use case and how we helped the client to tackle a real time problem by setting up an Automated Quality Controls process for Data Delivery to Analysis Teams.

The Client had a problem statement of running 2000+ Database queries across 180+ DB tables across different Delivery checkpoints. This was manual, much time consuming and prone to manual error.

The Data delivered to downstream systems was through different Business Layers, some in Hadoop, a few in Oracle and a few in files. I from Automation perspective saw the pattern of these queries and how we can simplify the whole process. I harnessed the power of Robot Framework and suggested to Automate the queries and we call it Data Quality Controls.

We used Robot Framework and Automated 2000+ Controls and this serves as entry and exit checkpoints at each Business level. These Data Quality Controls run every month to ensure accuracy, completeness, consistency, validity and no wrong data is supplied to the DownStream system.

Framework Architecture:
We build a Hybrid Test Automation Framework with Page Object Model, combined with Keyword and Data Driven Architecture to cater our needs.

Tech Stack: Hadoop, HDFS, Oracle, Unix and Python
Test Automation: Robot Framework with Python

Savings:
The Quality Control Validations which were previous performed by Business Users for weeks to months, got reduced to less than a Day's effort. We saved over 5000+ Person Days over the years.

Other Information:
Client Details:
The client is one of the top Banks in Nordics. The Bank has its presence wide spread across Denmark, Sweden, Finland, Norway and Poland.

Project Description:
The project is a regulatory compliance project for the Bank.

About Me:
I am an Automation Solution Architect and Automation Consultant with 12+Years of Experience, working for One of Top Global Tech Company- Tata Consultancy Services. I am from Chennai, India and I am currently in Sweden on Deputation.

I have worked over a decade in Big Data Testing (Hadoop-Hive, Impala, HBase, HDFS) and Oracle DBs.

Automation and Frameworks:
UI/API/DB/ETL Test Automation, Robot Framework Testing, Keyword/Data/Behaviour Driven Frameworks, POM Framework, TestNg and Hybrid framework

RPA:
UI Path- Advanced Developer Certified

Automation Tools:
Backend- Robot Framework Testing, Fitnesse Test Automation Tool, Talend Data Integration and ETL Test automation using Excel Marco

UI- Selenium Web Driver (Page Object Model and Hybrid Frameworks) and Selenium Grid

API- SOAP UI and Rest Assured

CICD- Jenkins

Languages known- C, C++, Java and Python

My LinkedIn Profile: https://www.linkedin.com/in/rohith-ram-prabakaran-28921180/


Describe your intended audience:

Data Warehouse Testing
ETL Testing

Is this suitable for ..?:

Beginner RF user, Intermediate RF user

Automation Solution Architect. Full Stack QA Automation Architect & Manager

Has wide range of Industrial experience including Banking, Retail, Airline and Market Research.

An expert in Architecting Test Automation Frameworks, ETL Test Automation, Big Data Automation and Robot Framework Testing

An expert in Automating Front-end, Web Services/API (SOAP and REST) and Backend application testing. Well versed with Python and Java programming languages. Highly experienced in CICD tools like Jenkins.