Pavan Kumar
Sr. Data Engineer
Egham, GB.About
Highly accomplished Sr. Data Engineer with 8 years of experience in designing, developing, and deploying robust data-driven solutions across diverse cloud platforms including Azure and AWS. Proven expertise in building scalable data platforms, optimizing data pipelines, and leveraging advanced analytics tools like Spark, Snowflake, and Tableau to drive business insights. Adept at leading end-to-end data engineering projects, collaborating with stakeholders, and mentoring teams to deliver high-quality, cost-efficient data solutions.
Work
Egham, Surrey, England, United Kingdom of Great Britain and Northern Ireland
→
Summary
Supported the HR and Finance departments by performing essential data reporting and analytics tasks, contributing to informed decision-making while pursuing a degree.
Highlights
Collected and analyzed HR & Finance data from diverse sources including HRIS and employee surveys, ensuring comprehensive data input for departmental needs.
Cleaned, transformed, and validated HR data, maintaining high standards of accuracy and consistency for reliable reporting.
Applied statistical data analysis techniques using PowerBI, Tableau, SQL, and SPSS to identify critical trends, patterns, and KPIs, generating actionable insights.
Provided crucial data support for regulatory reporting, audits, and compliance, ensuring adherence to institutional standards.
Bangalore, Karnataka, India
→
Summary
Led end-to-end data engineering initiatives, from architecture to implementation, delivering robust data analytics solutions across various domains.
Highlights
Architected and implemented end-to-end data analytics solutions across diverse domains, designing robust data models and performing complex transformations using Alteryx, SSIS, Tableau Prep, and AWS Glue.
Developed and managed scalable data pipelines on Azure using Databricks, Spark (RDDs), and complex ETL processes, ensuring efficient data transformation and integration with Snowflake.
Led hands-on development of data pipelines utilizing AWS Step Functions, Glue, Python/Pyspark, and DBT (Redshift) to process large datasets, optimizing performance and cost-efficiency.
Enhanced data accessibility and business insights by organizing and managing structured/unstructured data with warehousing technologies and improving data quality and efficiency.
Presented data insights through visually impactful dashboards (Tableau, PowerBI, AWS QuickSight, Tableau CRM) to project leads and stakeholders, influencing critical decision-making processes.
Gurgaon, Haryana, India
→
Summary
Designed and implemented comprehensive data solutions, ensuring robust data infrastructure and high-quality data for analytical goals.
Highlights
Designed and implemented robust data solutions, collaborating with data analysts and scientists to align infrastructure with analytical goals and business requirements.
Developed and maintained efficient data ingestion and transformation pipelines using Snowflake's native features (Snowpipe, Tasks), ensuring seamless data flow.
Managed end-to-end data movement and migration processes, transforming diverse raw data into usable formats for data lakes and warehouses (e.g., SQL Server to AWS Redshift).
Ensured high data quality and consistency across all data processes through comprehensive cleaning, transformation, and validation.
Bangalore, Karnataka, India
→
Summary
Designed and implemented end-to-end Data Engineering solutions, leveraging Microsoft Power Platform and Tableau for impactful visualizations.
Highlights
Designed and implemented end-to-end data engineering solutions using Microsoft Power Platform and Tableau visualizations, enhancing data accessibility and reporting capabilities.
Acted as a Project Coordinator, effectively bridging communication between analysts and a diverse range of stakeholders from various domains.
Managed multiple stakeholder relationships, ensuring requirements were met and project objectives were aligned across different departments.
Bangalore, Karnataka, India
→
Summary
Developed automation solutions for MIS reports, significantly reducing manual effort and improving efficiency.
Highlights
Designed and implemented automation solutions for Management Information Systems (MIS) reports using Excel VBA and Macro Express.
Achieved a considerable reduction in manual efforts through process automation, significantly improving reporting efficiency and accuracy.
Education
Languages
English
Skills
Cloud Platforms
AWS Cloud, Microsoft Azure, Salesforce Cloud, Power Platform.
Data Warehousing & Databases
Snowflake, Azure SQL Data Warehouse, Azure Cosmos DB, AWS Redshift, AWS S3, Azure Data Lake Storage, MySQL, PostgreSQL.
Data Processing & ETL
Azure Databricks, Apache Spark, Azure Data Factory, AWS EMR, AWS Glue, dbt, MSBI (SSIS), Alteryx, Tableau Prep, Data Recipe, ETL Processes, AWS Step Functions, Python/Pyspark.
Business Intelligence & Visualization
Tableau, PowerBI, AWS QuickSight, Tableau CRM, Dashboards, Presentations.
Programming & Scripting
Python, SQL, SAQL, VBA, M Query, SOQL.
Orchestration & Monitoring
Airflow, Splunk, Azure DevOps.
Data Modeling & Architecture
Schema Designing, Data Modeling, End-to-end Data Analytics Solutions.
Data Quality & Governance
Data Cleaning, Data Transformation, Data Validation, Data Integrity, Data Governance.
Project Management & Stakeholder Management
Project Coordination, Stakeholder Management, Requirements Gathering, Decision-making Processes, Team Training.
Statistical Analysis
Statistical Data Analysis, SPSS, KPIs, Trends Identification, Pattern Recognition.