Find Your Dream Job

1. Location- Gurugram, Mumbai, Pune & Bangalore
2. Years of experience - 3- 8years

We are seeking skilled and dynamic Cloud Data Engineers specializing in AWS, Azure, Databricks. The ideal candidate will have a strong background in data engineering, with a focus on data ingestion, transformation, and warehousing. They should also possess excellent knowledge of PySpark or Spark, and a proven ability to optimize performance in Spark job executions.

Key Responsibilities:

- Design, build, and maintain scalable data pipelines for a variety of cloud platforms including AWS, Azure, Databricks.

- Implement data ingestion and transformation processes to facilitate efficient data warehousing. - Utilize cloud services to enhance data processing capabilities:

- AWS: Glue, Athena, Lambda, Redshift, Step Functions, DynamoDB, SNS.

- Azure: Data Factory, Synapse Analytics, Functions, Cosmos DB, Event Grid, Logic Apps, Service Bus.

- Optimize Spark job performance to ensure high efficiency and reliability.

- Stay proactive in learning and implementing new technologies to improve data processing frameworks.

- Collaborate with cross-functional teams to deliver robust data solutions. - Work on Spark Streaming for real-time data processing as necessary.

Qualifications:

- 3-8 years of experience in data engineering with a strong focus on cloud environments.

- Proficiency in PySpark or Spark is mandatory.

- Proven experience with data ingestion, transformation, and data warehousing.

- In-depth knowledge and hands-on experience with cloud services(AWS/Azure):

- Demonstrated ability in performance optimization of Spark jobs.

- Strong problem-solving skills and the ability to work independently as well as in a team.

- Cloud Certification (AWS, Azure) is a plus.

- Familiarity with Spark Streaming is a bonus.

Apply with your details at below link https://forms.office.com/r/mtWD1WL6Rt