AWS Data Engineer
Responsibilities:
• Design AWS architectures based on business requirements.
• Create architectural diagrams and documentation.
• Present cloud solutions to stakeholders.
• Design, develop, and maintain scalable ETL/ELT pipelines using AWS services like Glue, Lambda, and Step Functions.
• Work with batch and real-time data processing using AWS Glue, Kinesis, Kafka, or Apache Spark.
• Optimize data pipelines for performance, scalability, and cost-effectiveness.
• Identify bottlenecks and optimize query performance on Redshift, Athena, and Glue.
Requirements:
• Strong knowledge of AWS services: EC2 S3 RDS, Lambda, IAM, VPC, CloudFormation, CloudWatch, etc.
• Experience with serverless architectures (AWS Lambda, API Gateway, Step Functions).
• Experience with AWS networking (VPC, Route 5,3 ELB, Security Groups, etc. ).
• Experience with AWS CloudFormation for automating infrastructure.
• Proficiency in scripting languages such as Python or Bash.
• Experience with automation tools (AWS Systems Manager, AWS Lambda)
• Experience with containerization (Docker, Kubernetes, AWS ECS, EKS, Fargate).
• Experience with AWS CloudWatch, AWS X-Ray, ELK Stack, or third-party monitoring tools.
• Experience with AWS database services (RDS, DynamoDB, Aurora, Redshift).
• Experience with storage solutions (S3 EBS, EFS, Glacier).
• Experience with AWS Direct Connect, Transit Gateway, and VPN solutions.
• Skills: AWS Cloud, aws data engineer.
Apply tot his job
Apply To this Job