Responsibility
Job Title: Big Data Engineer
Experience: 5+ Years
Employment Type: Permanent
Location: Gurgaon / Bangalore
Work Mode: Hybrid
Role Summary
We are looking for a skilled Big Data Engineer with strong expertise in AWS, distributed data processing, and large-scale data systems. The ideal candidate should have hands-on experience with modern data technologies, strong SQL skills, and the ability to design and optimize high-performance data pipelines.
Key Responsibilities
- Design, optimize, and maintain large-scale relational and distributed data systems
- Write complex SQL queries for analytics, reporting, and data validation
- Implement indexing, partitioning, and performance tuning strategies
- Manage schema design, data modeling, and data quality best practices
- Develop and maintain batch and real-time data pipelines
- Work with cross-functional teams to support data-driven use cases
Required Skills & Experience
- 5+ years of experience in Big Data or Data Engineering
- Strong experience with AWS services, including:
- AWS RDS, AWS Lambda, AWS Glue
- Apache Spark, Kafka, Spark Streaming, Hive
- Experience working with SQL and NoSQL databases such as:
- MySQL, PostgreSQL, Elasticsearch
- Hands-on experience with Spark programming paradigms:
- Batch processing
- Stream processing
- Strong programming skills in Java and Scala
- Familiarity with Python and Unix/Linux shell scripting
- Advanced SQL expertise, including:
- Query optimization
- Indexing strategies
- Performance tuning
- Strong analytical and problem-solving skills