Aktuelle Jobs

Databricks Data Engineer

 Brussels, Belgium

 

Contract

We are seeking a skilled Databricks Data Engineer to establish and optimize Databricks environments and contribute to fostering a data-driven culture. You will collaborate with data experts, DBAs, and data scientists to build scalable data products and analytics solutions, playing a pivotal role in this new platform strategy's success.

Key Responsibilities:

• Design, build, and maintain scalable data architectures and data lakes on Databricks.
• Create robust monitoring and alerting systems for proactive issue identification and resolution.
• Collaborate with data engineers to ensure scalability, reliability, and security of Databricks clusters.
• Develop, optimize, and troubleshoot data pipelines, SQL queries, and Spark jobs.
• Ingest, transform, and load data from various sources using Databricks.
• Support data scientists and analysts with technical guidance for Databricks usage.
• Document solutions, architectures, and processes for Databricks implementations.
• Stay updated on advancements and best practices in Databricks and big data technologies.

Required Skills and Experience:

• Strong knowledge of big data technologies (e.g., Apache Spark, distributed computing).
• Experience with cloud platforms, preferably AWS Databricks.
• Proficiency in data integration, modeling, and warehousing concepts.
• Expertise in ETL processes, streaming, and batch data handling.
• Advanced SQL skills with query optimization and performance tuning expertise.
• Programming skills in Python, Scala, or SQL.
• Knowledge of exposing data for dashboarding and analytics.
• Familiarity with data governance, security, and compliance in big data environments.
• Experience in installing and configuring Databricks clusters and their dependencies (advantageous).

#LI-SD2