KOTHA SHWETHA
Big Data Engineer
Hyderabad, IN.About
Results-driven Big Data Engineer with 3 years of experience in data analytics and ETL solutions, proficiently managing and analyzing terabytes of data for US-based clients. Expert in developing scalable data pipelines and generating actionable insights for business decision-making using tools like Spark, Snowflake, Airflow, Tableau, Python, and SQL. Eager to leverage strong technical and analytical strengths in a challenging Data Science, Data Analysis, or Visualization role to deliver impactful solutions.
Work
Hyderabad, Telangana, India
→
Summary
Spearheaded Big Data development and ETL solutions for US-based clients, optimizing data processing and analytics workflows.
Highlights
Engineered and maintained robust Airflow DAGs, automating MAP clusters to significantly streamline data processing workflows and enhance operational efficiency.
Leveraged Big Data technologies, including Spark and Snowflake, to efficiently analyze and process terabytes of data, generating critical insights for business decision-making.
Designed and implemented scalable data ingestion pipelines using Airflow, extracting data from diverse sources and loading them into AWS S3 for robust data storage.
Managed and optimized metadata tables within AWS RDS databases, ensuring data integrity and accessibility for advanced analytics and reporting functions.
Collaborated cross-functional teams to gather requirements, manage JIRA sprint boards, and deliver impactful data solutions, improving stakeholder satisfaction.
Conducted comprehensive data quality analysis, profiling, and validation, ensuring accuracy and reliability for business-critical monthly data executions.
Developed, tested, and documented complex code changes for enterprise software applications, contributing to system stability and performance.
Education
Nova college of engineering and technology
In class
Jafferguda
Grade: 73.4
Awards
ACE Alliance Award
Awarded By
GSPANN Technologies Inc
Recognized for consistently delivering high-quality service and impactful solutions to clients, demonstrating excellence in professional contributions.
Languages
English
Hindi
Skills
Big Data Technologies
Spark, PySpark, Hadoop, Big Data.
ETL & Orchestration
ETL, Airflow, Big Data Airflow.
Databases & Data Warehousing
SQL, AWS RDS, Snowflake.
Programming
Python, R, Pandas.
BI & Visualization
Tableau, Power BI, Advanced Excel.
Cloud Platforms
AWS, Azure.
DevOps & Version Control
Git, CICD.
Development Tools
VisualStudio.
Soft Skills
Client Handling, Communication, Problem Solving, Leadership, Presentation, Mentoring.