SreenivasNaik M.S

SreenivasNaik M.S

Senior Product Engineer | Backend & Distributed Systems | Scala • Java • Kafka • Spark • Kubernetes | Exploring GenAI & Agentic AI


About

Senior Product Engineer with 10 years of experience building scalable backend systems, distributed services, data pipelines, and cloud-native applications. I work primarily with Scala, Java, Akka, Play, Spring Boot, Kafka, Spark, Kubernetes, Docker, AWS/EMR, Airflow, and databases such as MySQL, Redis, Cassandra, and HBase. My experience includes designing microservices, event-driven systems, large-scale data ingestion pipelines, Spark-based processing, and production-ready cloud-native solutions. I enjoy solving complex engineering problems and turning them into simple, reliable, and scalable systems. Currently, I'm expanding my expertise in Generative AI and Agentic AI, with a focus on understanding how AI agents can be integrated with real-world software engineering and product systems. I enjoy learning, building, sharing knowledge, and connecting with engineers and technology communities. Tech interests: • Backend Engineering & Distributed Systems • Scala & Java • Kafka & Event-Driven Architecture • Apache Spark & Big Data • Kubernetes & Cloud-Native Systems • Microservices & System Design • Generative AI & Agentic AI

Skills
Java
Python
Scala
Spark
System Design
EMR
Kubernetes
Docker
SpingBoot
GenAI
AgenticAI
MCP
Experience

Senior Product Engineer

Experian

Nov 2023 to Present
  • Engineered high-volume data ingestion pipelines using Scala, Apache Spark, EMR Serverless, S3 and Airflow, processing 7M+ XML files, with extraction completed in ~7 minutes and processing/transformation of millions of records in ~14 minutes.
  • Designed a reusable, plugin-based XML processing framework supporting schema validation, data extraction, transformation and XML-to-Parquet/CSV processing for large-scale data feeds.
  • Modernized Spark workloads from EMR on EC2 to EMR Serverless, reducing the evaluated workload from ~992 cores / 7.9 TB memory to ~26 cores / 190 GB.
  • Optimized a production data-processing pipeline from ~2 hours to 12 minutes, achieving ~90% improvement in processing time through Spark and code optimizations.
  • Built a Core Parquet layer with metadata and delta-detection capabilities to efficiently manage daily and large periodic data deliveries.
  • Implemented S3-based marker-file validation to prevent outdated files from being processed, improving data consistency and processing reliability.
  • Developed data delivery applications using Java, Scala and Spring Boot microservices, with REST APIs, Kafka integrations and resilient backend processing.
  • Improved application reliability through API retry mechanisms, health probes, functional testing, static analysis and security/vulnerability remediation.
  • Automated release workflows using Jenkins, including version synchronization, PR creation and branch merging, reducing manual release activities.
  • Contributed to architecture, technical documentation, production support, mentoring, technical interviews and cross-team engineering initiatives.
  • Recognized as Employee of the Quarter – “The Version Virtuoso” and received two Level 2 Spot Awards under Innovate to Grow.

Cloud Engineer

Cisco

May 2021 to Nov 2023
  • Designed and delivered multiple features for the WebEx Cloud Contact Center, enhancing customer-agent interactions.
  • Developed Jenkins automation jobs to facilitate load testing and ticket updates, improving efficiency.
  • Implemented canary deployments for applications, ensuring smooth releases and minimizing downtime.
  • Integrated various metrics and alerting mechanisms, enhancing product reliability and availability.
  • Utilized technologies like Scala, Akka HTTP, Apache Kafka, Kafka Streams, Grafana, Prometheus, and Kubernetes to achieve project goals.

MTS II - Sys Engrg

Verizon

Feb 2019 to Apr 2021
  • Spearheaded the development of a seamless device and plan purchase experience for millions of Verizon customers, including existing, new, and prepay customers.
  • Designed and implemented an order status module allowing all customer types to easily access and check their order details.
  • Leveraged technologies such as Java SE8, Play and Akka Frameworks, Springboot, Microservices, Apache Kafka, Redis, Restful Services, Artillery, and Elastic search to achieve project goals.

Systems Engineer

TCS

Sept 2016 to Feb 2019
  • Responsibility: Developed REST web services and authored unit and performance test classes for an eCommerce application allowing users to purchase internet bundles and IPTV services.
  • Technologies Used: Java 8, Play & Akka Frameworks, Apache Kafka,
Education

B.Tech CSE

AP IIIT RK VALLEY · 8.9

Jun 2012 to Jun 2016