Job Title:
Cloud Applications and Data Pipeline Engineer
Location:
Boston, MA
Job Type:
Permanent
Job Summary
We are seeking a
highly skilled Cloud Applications and Data Pipeline Engineer to design, develop, and maintain
scalable cloud-based applications and robust data pipelines. You will contribute to both front-end and back-end development, leverage AWS services and the Nextflow workflow language, and implement DevOps and CI/CD best practices to ensure reliable, automated deployment and operations.
Key Responsibilities
- Design, develop, and maintain cloud-based applications to implement data pipelines and manage data synchronization using AWS services such as Lambda, Step Functions, API Gateway, DataSync, Glue, S3, EventBridge, and RDS.
- Work on full stack development projects, including both front-end and back-end, ensuring cohesive integration and functionality.
- Utilize Nextflow language to develop and optimize workflows for data processing and analysis.
- Implement CI/CD pipelines to automate deployment and ensure continuous integration and delivery.
- Apply DevOps practices to streamline development, deployment, and operations processes.
- Troubleshoot and resolve issues related to cloud infrastructure, application performance, and data integration.
Essential Skills, Knowledge, And Experience
- 5-7 years of experience in cloud computing and application development.
- Familiarity with AWS services best practices, including security, scalability, and cost optimization.
- Proven experience with AWS services such as Lambda, DataSync, Glue, S3, RDS, EventBridge, and EMR.
- Experience with containerization technologies such as Docker and Singularity.
- Solid understanding of serverless architecture and microservices.
- Proficient in full-stack development with expertise in both front-end and back-end technologies, including databases, data storage, and Python.
- Expertise in Nextflow language for workflow management and data processing.
- Experience with DevOps practices and tools (e.g., Docker, Kubernetes).
- Experience with database management and data integration.
- Excellent problem-solving skills and the ability to work independently and as part of a team.
- Strong communication skills to effectively collaborate with team members and stakeholders.
- Experience working in bioinformatics, data science, or scientific computing environments.
Education
- Bachelor’s degree in Computer Science, Information Technology, or a related field.