About
Highly analytical Azure Data Engineer with over 10 years of IT experience, including 4 years specializing in robust Azure cloud data solutions. Expert in designing, developing, and implementing scalable ETL/ELT pipelines, data models, and data warehouses using Azure Data Factory, Databricks, and Spark SQL. Proven ability to transform complex business requirements into high-impact analytical solutions, optimize database performance, and ensure seamless data integration for enterprise-level applications.
Skills
Cloud Platforms
Microsoft Azure, Azure Data Lake, Azure Data Factory, Azure Databricks, Azure Key Vault, Azure Stream Analytics, Snowflake.
Databases & Data Warehousing
SQL Server, Azure SQL DB, IBM DB2, MongoDB, Azure SQL Data Warehouse, OLTP, OLAP, Delta Lake.
Methodologies & Practices
Agile Methodologies, Sprint Planning, Daily Scrum, Sprint Review, Sprint Retrospective, PDD (Process Definition Document), BRD (Business Requirement Document), TDD (Technical Design Document), Performance Tuning, Troubleshooting.
DevOps & Tools
Jira, Endevor, Git, Spufi, CA-7, Service Now, Azure DevOps, SQL Profiler, Indexing.
Data Analysis & Visualization
Power BI, Data Modeling, Statistical Data Analysis, Data Visualization, Report Generation.
Programming Languages & Frameworks
SQL, Python, PySpark, Shell Scripting, Spark-Core, Spark-SQL, Cobol, Omni Script.
ETL & Data Integration
ETL, ELT, Data Extraction, Data Transformation, Data Loading, Azure Data Factory (ADF), Kafka Connect.
Experience Chornicle
TCS
|Technical Lead
Hyderabad, Telangana, India
→
Summary
Led the L&G Data Processing Project as an Azure Data Engineer, focusing on data migration, pipeline development, and analytics to drive business performance and operational efficiency.
Highlights
Led end-to-end data migration initiatives using SQL Azure, Azure Data Lake, and Azure Data Factory, enhancing data accessibility and integration for enterprise applications.
Designed and deployed scalable ETL/ELT pipelines and datasets in Azure Data Factory, enabling automated data processing based on historical and delta loads.
Processed diverse data volumes in Azure Databricks using Spark SQL, deploying solutions via Azure Data Factory pipelines, ensuring efficient data transformation.
Developed analytical tools leveraging data pipelines to generate actionable insights, improving customer acquisition and operational efficiency.
Implemented Azure Key Vault for secure management of sensitive data and credentials, bolstering data security posture and compliance.
Voya Financials (previously: VFISLK)
|Analyst & Designer
Hyderabad, Telangana, India
→
Summary
Served as an Analyst & Designer for the Financial Data Processing Project, specializing in Hadoop and RDBMS environments for data integration and comprehensive reporting.
Highlights
Designed and maintained robust data integration programs across Hadoop and RDBMS environments, enabling comprehensive data access and analysis from diverse sources.
Utilized Spark Streaming APIs to perform real-time data transformations, building a common learner data model from Kafka streams.
Managed highly scalable structured data using Cassandra across numerous commodity servers, ensuring fault tolerance and no single point of failure.
Developed Spark code with Scala and Spark SQL for faster data processing and testing, optimizing data retrieval through complex HiveQL queries on Hive tables.
Generated daily data reports by connecting Tableau with Hive, providing critical business insights and supporting data-driven decision-making.
HCL Technologies
|Sr. Software Engineer
Hyderabad, Telangana, India
→
Summary
Contributed as a Senior Software Engineer, focusing on software development, data integration, and system performance improvements.
Highlights
Optimized database performance by leveraging indexing and SQL Profiler, significantly reducing stored procedure run times and accelerating report generation.
Developed ETL processes to load data from diverse sources into HDFS using FLUME and SQOOP, enhancing data integration capabilities.
Contributed to data warehouse development, including extraction, loading, and data modeling, ensuring smooth application performance and data integrity.
Optimized existing Hadoop algorithms using Spark Context, Spark SQL, Data Frames, and Pair RDDs for enhanced processing efficiency.
Collaborated with cross-functional teams to troubleshoot incidents and provide technical support to end-users, ensuring seamless operations.
Cognizant Technology Solutions
|Programmer Analyst
Hyderabad, Telangana, India
→
Summary
Began career as a Programmer Analyst, contributing to foundational software development and data-related initiatives.
Highlights
Collaborated with Subject Matter Experts (SMEs) and process owners to gather and clarify requirements, utilizing PDD, BRD, and TDD methodologies to ensure project alignment.
Assisted in designing and implementing ETL/ELT processes for efficient data integration from various source systems.
Developed a foundational understanding of application data models and actively participated in data modeling activities.
Demonstrated strong organizational skills and adaptability, effectively managing multiple tasks and shifting priorities to meet project deadlines.
Contributed to the development and maintenance of enterprise-level applications, ensuring smooth running and data consistency.
Certificates
DP-900 – Microsoft Azure Data fundamentals
Issued By
Microsoft
DP-203 – Microsoft Azure Data Engineer Associate
Issued By
Microsoft
Snowpro core certification(COF-C02)
Issued By
Snowflake
Education
Birla Institute of Technology Mesra
→
Master of Engineering (M.E)
Engineering
Grade: 8.3 CGPA
Languages
English
Fluent
Telugu
Native
Hindi
Fluent