Our partner provides business service to help companies identify legitimate customers, prevent fraudulent transactions, and smooth new customer creation. Their real-time data integrates into existing platforms, authentication workflows, and data models to help your business confidently assess and verify consumer identities worldwide.

Data services team is responsible for managing the Global Identity Graph, which holds and serves all identity information. Backed by proprietary state-of-the-art Graph Database, and populated by Spark based big-data ingestion pipeline, serving hundreds of thousands of request per second at low latency.

In the Big data Engineer role you will:

• Design and development of processing large data files as per product requirements using Spark framework.
• Develop deep understanding of Spark and its internals to continually optimize the ingestion pipeline.
• Maintain sufficiently generic yet simple and economical solution.
• Insist on highest coding standards, follow and create best practices for clean code and architecture.
• Manage a sense of urgency and risks on project timelines and proposes creative strategies for delivering constant business value.
• Develop deep understanding of data, get a good sense of signal vs noise to help business with shape new products.