
Sr Data Engineer
Join the team
Information
We are looking for a Data Engineer to join our team for one of the most important clients.
Our client develops products for communication endpoint,encryption, network security, email security and mobile security as well as unified threat management.
Requirements:
4+ years of experience leading big data teams.
2+ years of experience in the public cloud, especially in AWS, mostly in PaaS
Ability to create MapReduce and DAG process from scratch.
Strong programming background.
Experience setting up big data environment on-premise and cloud (AWS/GCP/Other).
Lead implementation of big data architecture to process, store and transform, heavy data workloads from multiple sources.
Ability to design pipelines and to decide which frameworks, tools, and libraries are better for the current project/client.
Great communication skills to interact with a different kind of audiences, like team members and stakeholders.
Management skills, ability to give feedback and make decisions that improves team productivity.
Be part of our global practice team and join us in advisories and workshops in the US and Europe.
Responsibilities:
The client Infrastructure is built atop Amazon Web Services resources with particular focus on Redshift, SNS/SQS, CloudWatch, CloudFormation, Apache Airflow, as well as processing applications running on EC2 and other compute resources in the cloud. Software is developed in Python; the AWS Redshift database implements the Postgres API.
