Data Engineer

Posted on 07/10/2021 | 818 views

JOB DETAILS COMPANY INFORMATION

APPLY NOW SAVE JOB

Short Description:

• Setting up Data stores structured, semi structured and non-structured.
• Secure data at rest via encryption
• Implement tool to access securely multiple data sources
• Implement solutions to run real-time analytics and data science.
• Use container technologies for jobs, microservices and databases.
• Willingness to learn
• Design and implement data engineering tasks/solutions
• Practice GitOps model to manage data pipelines

Requirements:

Experience in Java, Spark is a must
• Experience in technologies like Elastic Search, Cassandra, Cockroach, YugabyteDB, Hadoop, S3,
Presto
• Experience working on Data science/ML pipelines is a plus
• Experience with Spark Delta Lake or Apache Iceberg is a plus
• Nice to have experience in distributed data processing, Kafka, Pulsar
• Experience with setting up and running NoSQL is a plus
• Experience of Unix/Linux environments is a plus
• Experience of Agile/Scrum development methodologies is a plus
• Knowledge of retail banking is a plus