Shubham Keshri

Role / Project Description

Principal Data Engineer

Created IaC code using terraform to deploy new dev/prod environment from scratch, migrated data from Synapse and Storage account, setup CI/CD for Azure Data Factory, Azure Databricks and Synapse using DevOps.

Technology Stack : Terraform, Azure Synapse Analytics, Azure Data Factory, Azure Databricks, Azure DevOps

Customer Benefits: Customer had only one environment for both dev and prod. Now there is a process established to handle all infra changes using terraform (IAC, RBAC) and CI/CD for data pipeline development using databricks/adf

Contact person at the customer: Manager, R&D Platform

Role / Project Description

Senior Data Engineer / Architect

Responsible for migrating (Retail Demo Experience reporting solution) legacy Cosmos + SQL server + SSAS solution to Azure Synapse using Deltalake. Technical hands-on work started with POC and deployed to production. Established CI/CD for ADF, ADB

Technology Stack : Azure Synapse Analytics, Azure Data Factory, PySpark, SparkSQL, Azure Analysis Services, Azure DevOps

Customer Benefits: Modernize their legacy solution from on-premise to Azure and reduced cost

Contact person at the customer: Director, Data and Analytics Platform

Role / Project Description

Principal Data Engineer

Azure Data Platform

Migration from Financial Data Platform to Centralized Data Plaform

Assessment, Architecture design, Project planning, estimations

Technology Stack : Azure Databricks, PySpark, Azure Storage Account, Azure Data Factory, SQL DW, Azure DevOps, Github, JIRA, Scrum

Customer Benefits: Assessment for Risks, Strategy and estimation for the migration

Contact person at the customer: Product Owner

Role / Project Description

Lead Data Architect

Azure Data Platform

Solution Designing - Azure Data Platform

Pre-sales, Architecture design, Project planning, estimations

Technology Stack : Azure Databricks, PySpark, Azure Storage Account, Azure Data Factory, SQL DW, Azure DevOps, Github, JIRA, Scrum

Customer Benefits: Understanding of modern tools in Azure, project plan, design.

Contact person at the customer: Data Platform and Technology Manager

Role / Project Description

Senior Data Engineer

Azure Data Platform

Design and implement DevOps practices in Azure Data Platform development

Technology Stack : Azure Databricks, PySpark, Azure Storage Account, Azure Data Factory, SQL DW, Azure DevOps, Github, JIRA, Scrum

Customer Benefits: Smooth elevation of code to higher environments, Automated pipelines in Azure Datalake

Contact person at the customer: Data Platform and Technology Manager

Role / Project Description

Senior Data Engineer

Common data platform - Azure

Solution Designing and developing Azure Data Platform

Designed and implemented data platform accelerator tool using Azure Databricks and Data factory

Technology Evaluation for modelling tools for Azure Synapse Analytics

Technology Stack : Azure Databricks, PySpark, Azure Storage Account, Azure Data Factory, SQL DW, Azure DevOps, Github, JIRA, Scrum

Customer Benefits: Customer data is modelled and utilised in creating self service reports on Power BI

Contact person at the customer: Data Platform and Technology Manager

Role / Project Description

Lead Data Engineer

Big Data Platform Azure

Solution Designing and developing Azure Data Platform

Designed and automated ingestion of data from SAP to Azure Datalake using Azure Databricks and Data factory. Created views on top of hive views using databricks database. Helped customer to learn new tools and self develop KPI's

Technology Stack : Azure Databricks, PySpark, Azure Storage Account, Azure Data Factory, SQL DW, Azure DevOps, Github, JIRA, Scrum

Customer Benefits: Customer was able to leverage cloud big data tools to create self service reports. Customer send a video feedback appreciating our efforts in the project

Contact person at the customer: Head of Data & Analytics

Role / Project Description

· Team lead - Leading a team of 5 members

· Analytics project building data lake and data warehouse on Azure ecosystem

· Architecting and developing Data warehouse automation tool

· Build end - end data fuelling data to Business reports

Technology Stack : Data Vault 2.0 (Modelling), Azure Storage Account, Azure Data Factory, SQL DW, PowerBI, JIRA, Scrum, Python

Customer Benefits: Customer data is modelled and utilised in creating self service reports on Power BI

Contact person at the customer: Manager, ICT Applications

Role / Project Description

· Data Engineer

· Analytics project building data lake and data wareshouse on AWS ecosystem

· Building DevOps data pipelines using python / ansible scripts to automate BI solutions

· Build end - end data fuelling data to Business reports

Technology Stack : AWS S3, Python, AWS Redshift, Github, Ansible, Jenkins, Rundeck, Qlikview, Superset, Linux, EC2, JIRA, Scrum

Customer Benefits: Business is able to make better decisions based on automated reports

Contact person at the customer: Product Owner

Role / Project Description

· Project Lead

· Setting up architecture and environment for Data virtualization POC. Requirement analysis and Pre-sales

· Presented Demo, Solution Design, implementation of Denodo and created reports using Power BI

Technology Stack: Denodo 7.0, MS SQL Server, AWS Infrastructure, Azure Infrastructure, Load Balancer, Share Point

Customer Benefits: Customer finds value in the solution.

Contact person at the customer: Process Manager BI & Analytics, Solution Manager

Role / Project Description

· Architect / Developer

· ETL solution design and development

· Informatica Platform administration

· Providing alternatives to ETL tools and cloud migration

Technology Stack: Informatica Power Center 10.x, Informatica Cloud, Service Now, SQL Server, Oracle DW, Azure SQL server

Customer Benefits: ETL implementation to automate HR solution, improved report reliability, cost effective integration solution alternatives

Contact person at the customer: Integration Owner, Head of Data and Analytics

Role / Project Description

· Data Virtualization Consultant

· Setting up architecture and environment for Denodo (Production and non-prod), RFP, requirement analysis, installation.

· Project started with POC for Data Virtualization. It realized into project for setting up high Availability clustered environment.

Technology Stack : Denodo 7.0, MS SQL Server, AWS Infrastructure, Azure Infrastructure, Load Balance, JIRA, Share point

Customer Benefits: Customer is able to utilize Data Virtualization tool for GDPR project and Single view of customer project.

Contact person at the customer: Enterprise Data Architect, Head of MDM

Role / Project Description

· Master's Thesis / Trainee

· Leading Business reporting team of 5 members

· Research, Development, Solution Design, Business analysis

· Integrating Product Data Management (PDM) tool (Teamcenter) with EDW for Business Reporting

Technology Stack: Informatica Power Center 9.x, SQL Server, Teamcenter, Oracle Exadata DW, Docker, Talend, Web Service, Trello, MSBI, TCL, JAVA

Customer Benefits: Improved integration by reducing integration time from 7 hours to 15 minutes

Contact person at the customer: Enterprise Architect, Solution Architect, Solution Manager

Role / Project Description

· Software Developer

· Loading data from database shards into HDFS automating it using Scoop. Creating Hive queries for predictive analytics for Sears products

Technology Stack: Hadoop, Hive, Scoop, MYSQL, Shell Scripts, API

Customer Benefits: Predictive analytics for shopping products for next year

Contact person at the customer: Team Lead, Group Manager