KARTHIK SHIVANNA
AWS Certified Senior Technical Solution Engineer | Big Data & Cloud Specialist
Bengaluru, IN.About
AWS Certified Senior Technical Solution Engineer with 7+ years of expertise in supporting complex data engineering solutions across AWS, Azure, and on-premise Big Data environments. Proven ability to troubleshoot critical production issues, optimize system performance, and enhance customer satisfaction for leading technology platforms like Spark and Databricks. Adept at driving technical problem-solving, root cause analysis, and strategic system optimizations to deliver high-impact solutions.
Work
MOENGAGE
|SENIOR TECHNICAL SOLUTION ENGINEER
BANGALORE, Karnataka, India
→
Summary
Led critical customer issue resolution and delivered exceptional service experience as a Senior Technical Solution Engineer at MoEngage, specializing in application and infrastructure debugging.
Highlights
Automated daily report generation from MongoDB by developing custom scripts, significantly improving data accessibility and operational efficiency.
Proactively monitored CPU utilization and conducted performance analysis using Grafana, identifying and resolving bottlenecks to optimize system resource allocation.
Streamlined CI/CD pipelines by configuring and optimizing Jenkins jobs, enhancing deployment frequency and reliability.
Led advanced debugging efforts across application, network (VPC, Subnet, Gateway), and Linux OS layers (process, memory, disk management), resolving critical production issues.
Implemented advanced optimization techniques including JVM Object tuning and Data Skew resolution, significantly enhancing Spark application performance.
Diagnosed and resolved complex memory and Garbage Collection issues in cluster environments, analyzing JVM threads to prevent outages and ensure system stability.
Provided critical backend support during outages, conducting root cause analysis to prevent recurrence and improve system resilience.
Mentored and guided junior team members in resolving complex technical issues, fostering knowledge transfer and accelerating problem resolution.
EMUDHRA (FOR DATABRICKS)
|TECHNICAL SOLUTION ENGINEER
BANGALORE, Karnataka, India
→
Summary
Engaged with customers to resolve critical, complex technical issues and provided exceptional customer service for Databricks platform and cloud environment challenges.
Highlights
Provided expert technical support for client cloud environments (AWS, Azure), resolving complex Databricks deployment and platform issues.
Troubleshot and resolved critical AWS services issues, including VPC, subnet configurations, S3, IAM roles, and networking, ensuring seamless cloud operations.
Addressed and mitigated Azure Cloud Services challenges, specializing in Azure Active Directory, role-based permissions, storage (ADLS Gen1/Gen2, Blob), and firewall configurations.
Leveraged deep expertise in Apache Spark and Databricks architecture to troubleshoot and resolve intricate platform and Spark application issues for clients.
Optimized Spark applications through advanced tuning techniques, including resolving data skewness, data shuffle, and small files query issues in distributed environments.
Resolved critical memory and Garbage Collection issues within Databricks clusters, conducting JVM thread analysis to restore optimal performance.
Managed and resolved product service outages, performing comprehensive Root Cause Analysis (RCA) to prevent future occurrences and enhance system reliability.
Facilitated successful environment migrations for clients from diverse platforms to Databricks, including on-premise and data migration strategies, and explored automation for data pipelines and auto-scaling.
SIMPLILEARN LTD
|TECHNICAL CONSULTANT
BANGALORE, Karnataka, India
→
Summary
Supported major clients like Wipro and Accenture in resolving Hadoop cluster and Spark platform issues, developing solutions, and setting up cloud infrastructure.
Highlights
Supported clients in resolving Hadoop cluster and platform issues, and fundamental Spark issues, post-completion of an intensive industry-level training program.
Developed and implemented technical solutions for major clients, including Wipro and Accenture, on various internal projects.
Troubleshot and resolved Cloud era platform and application memory issues, providing Root Cause Analysis (RCA) to clients.
Guided customers in setting up Cloud era clusters and resolved critical technical issues during deployment phases, ensuring successful platform implementation.
Applied strong Linux operating system expertise, including process management, memory/disk management, and file system optimization, to enhance client environments.
Collaborated with Engineering and Content teams to develop and enhance Spark and Hadoop platforms and related educational content for B2B clients.
Education
OXFORD COLLEGE OF ENGINEERING, VTU UNIVERSITY
→
Master
Computer Application
Grade: 64.45%
S.R.S.F.G.C TUMKUR UNIVERSITY
→
Bachelor
Computer Application
Grade: 74.45%
Certificates
AWS Certified Cloud Support
Issued By
AWS
Skills
Cloud Services
AWS, Azure, VPC, Subnet, S3, IAM Roles, Azure Active Directory, ADLS Gen1, ADLS Gen2, Blob Storage, Firewall.
Big Data Technologies
Apache Spark, Databricks, Hadoop, MongoDB, Data Skew, Data Shuffle, Distributed Environment.
Operating Systems & Networking
Ubuntu, Windows Server, Linux, Process Management, Memory Management, Disk Management, File System, Networking, Router, Gateway.
Programming & Scripting
Scala, Core Java, Python, Shell Scripting, SQL, RDBMS (MySQL), NoSQL (MongoDB).
DevOps & Tools
Jenkins, GIT, Maven, SBT, CI/CD, GitHub, Grafana.
Troubleshooting & Optimization
Debugging, Root Cause Analysis (RCA), Performance Analysis, JVM Thread Analysis, Garbage Collection (GC), Object Tuning, Application Optimization.
Data Management
Data Warehousing, ETL, Data Migration, Data Pipelines.
Security & Identity
SSL, SSO, ADFS Server, Active Directory.
Interests
Hobbies
PC Games, Outdoor Games, Bicycling.
Professional Development
Tech Meetups, New Technologies.