Senior Backend Engineer in Remote (CET +/- 2 hours)

5 days ago
Deepset
Senior Level
Full Time
Anywhere (100% Remote)
Texts are the fabric of the digital world. There’s so much information at our fingertips, but making sense of it efficiently is still very hard. Deepset's mission is to break this barrier, and empower any developer to harness powerful NLP pipelines to efficiently access and comprehend any kind of data. Our open-source project Haystack is already used all around the world and we set out to become the semantic layer in every enterprise tech stack.

In this position, you will join us as a software engineer with a dedicated focus on our SaaS platform and help us designing the core architecture for a fast, reliable, and enjoyable developer product. You will work in an interdisciplinary team of backend, frontend and DevOps folks. As we are building a product that no one has built before, you will need to crack some tough nuts around scalability, distributed systems, and user-friendly API design.


Examples: Reduce the latency of search requests; Integrate Ray for distribution of complex search pipelines; Implement a task queue with Celery; Design a REST Endpoint for the conversion of documents


Your Responsibilities

  • Design & build the backend infrastructure comprising of clusters of high-end GPUs
  • Evaluate & implement machine learning libraries like ONNXRuntime, TensorRT, PyTorch, Ray, Cortex, and KubeServing to scale neural search for large scale production workloads
  • Design schemas for storage & retrieval of large data volumes from datastores like PostgresSQL, Elasticsearch, and Milvus.
  • Design, build & operate REST APIs to enable developers implement neural search in their applications
  • Work closely with our NLP & Open Source Engineers for integrating new features

Requirements

  • 5+ years experience of having worked in a related field
  • University degree in Computer Science or comparable qualification
  • Excellent Software Engineering skills
  • Strong track record of designing complex software projects
  • Expert in Python (or another language and the ability to pick up Python fast)
  • Experience with databases like PostgreSQL, MongoDB, or Elasticsearch
  • Experience with Git, AWS, container orchestration, and deployment
  • Experience with Machine Learning/NLP or the motivation to learn about it
  • Pragmatism, sense of responsibility and independent work style

Benefits

  • Fast & expanding environment - Team lead possibilities, fast decisions, direct impact and flexibility
  • We live and breathe open source: See Haystack, FARM, German BERT ...
  • Latest machine learning & tech - no legacies
  • Collaborate with tech experts - we understand your language & problems
  • Work on real-world cases - no AI hype
  • Possibility to speak at conferences and workshops
  • True ownership - stock options to participate in our common success
  • Working in a remote setting (Timezone: CET +/- 2 hours)


About deepset

  • One of the leading companies in transformer-based NLP
  • Living Open Source - in products and culture
  • We know the problem that we are solving like nobody else
  • Backed by renowned and mission-driven investors (Ex-Google, Ex-Microsoft ...)
  • Collaborations with AWS, Nvidia & more