Kapcsolódás...

Big Data Engineer

Lokáció Budapest IX. kerület
Iparág
Állás típusa Teljes munkaidős
Elérhető 3 hónapja
Referencia szám 4-10-38948

Pozícióleírás megtekintése

Our partner provides business service to help companies identify legitimate customers, prevent fraudulent transactions, and smooth new customer creation. Their real-time data integrates into existing platforms, authentication workflows, and data models to help your business confidently assess and verify consumer identities worldwide.

Data services team is responsible for managing the Global Identity Graph, which holds and serves all identity information. Backed by proprietary state-of-the-art Graph Database, and populated by Spark based big-data ingestion pipeline, serving hundreds of thousands of request per second at low latency.

In the Big data Engineer role you will:

  • Design and development of processing large data files as per product requirements using Spark framework.
  • Develop deep understanding of Spark and its internals to continually optimize the ingestion pipeline.
  • Maintain sufficiently generic yet simple and economical solution.
  • Insist on highest coding standards, follow and create best practices for clean code and architecture.
  • Manage a sense of urgency and risks on project timelines and proposes creative strategies for delivering constant business value.
  • Develop deep understanding of data, get a good sense of signal vs noise to help business with shape new products.

Requirements

Our ideal Big Data Engineer will have:
  • Experience building complex ETLs, Data Warehousing or custom pipelines from multiple data sources, including proper monitoring, alerting, verification, and metrics in a commercial environment.
  • Experience with the Spark ecosystem in production environment.
  • Experience with Databricks and related platform.
  • Experience working with extremely large datasets, using tools such as Spark, Hadoop.
  • Passion for diving deep in data and insights.
  • Strong sense of urgency and bias for results.

Preferred qualifications:
  • Fundamentals around JVM and garbage collection optimization understanding.
  • Familiarity with Spark.
  • Bachelor’s degree in Computer Science or a related area.
  • Excellent written and spoken English and Hungarian skills.

Benefits

What they offer:
  • Opportunity to improve your technical skills (Individual training budget)
  • Very ergonomic and fancy office environment (Lifting tables, ergonomic chairs)
  • Extremely comptetive salary – its not a regular bullshit 
  • Stock option
  • Annual team building and workshop in the USA.

Other notes

To apply for this offer, please follow the "Apply now" button. The salary rates might be presented here are monthly gross and are based on Grafton Recruitment's research into salary trends. The final salary offered upon hiring will depend on how closely the candidate meets the requirements set out in the job offer. Job offers by Grafton Recruitment are not commercial offers within the meaning of the Hungarian Civil Code. We kindly inform you, that we will process all applications with full discretion and contact selected candidates. Your personal data will be processed and used according to our Privacy Policy.

For more related job opportunities visit www.grafton.hu/en/job-search?disciplines=informatika-tavkozles

IT and Telecommunications | Software Development | Programmer / developer | Senior | IS/IT fejlesztő