Big Data Engineer (Spark)
Full-timeRemoteIn English
About the job
Nebul B.V. is building a sovereign European alternative to hyperscalers and is looking for a Big Data Engineer to architect and operate scalable Apache Spark environments on their AI cloud. You will design GPU-accelerated Spark workloads and partner with cross-functional teams to shape their managed Spark offering.
What you will do
- Architect, deploy, and operate scalable Apache Spark environments on sovereign AI cloud
- Design and optimize Spark workloads for GPU-accelerated and distributed performance
- Define and implement best practices for security, monitoring, governance, and data protection
- Partner with product, engineering, and customer teams to shape managed Spark offering
- Evaluate and integrate complementary technologies like Delta Lake and Lakehouse components
- Support early customer pilots and translate feedback into roadmap improvements
What you bring
- 4–7 years of experience with Apache Spark in production
- Deep knowledge of Spark internals: performance tuning, partition strategies, caching, shuffle management
- Hands-on deployment experience in Kubernetes, cloud infrastructure, or on-prem clusters
- Solid understanding of distributed data platforms like Databricks, EMR, Hadoop, Lakehouse architectures
- Strong scripting and automation skills in Python or Scala
- Based in the Netherlands, commutable to Leiden, and valid EU work permit
Nice to have
- Experience with GPU acceleration for Spark, RAPIDS, or ML workloads
- Exposure to high-security or regulated environments
- Knowledge of observability stacks like Prometheus and Grafana, and orchestration like Airflow or Argo
- Contributions to open-source or performance engineering work
- Background in data engineering or MLOps
What you get
- Build a sovereign European alternative to hyperscalers
- Lead creation of a key product capability for AI and data innovation
- Collaborate with world-class engineers across cloud, security, and high-performance compute
- Hybrid environment near The Hague and Amsterdam
- Competitive compensation, growth opportunities, and equity participation
About Nebul B.V.
Nebul B.V. is building a sovereign European alternative to hyperscalers.
Summary by Personeel.com. The full job description and the application form are on Nebul B.V.'s website (nebul-bv.jobs.personio.com); Apply takes you straight there.