info@digest.pro

Subscribe to our Digest

    I`m interested in (select one or more)

    HomeVacanciesSenior Data Engineer with Python and Databricks

    Senior Data Engineer with Python and Databricks

     

    Company DescriptionTechnology is our how. And people are our why. For over two
    decades, we have been harnessing technology to drive meaningful change.   By
    combining world-class engineering, industry expertise and a people-centric
    mindset, we consult and partner with leading brands from various industries to
    create dynamic platforms and intelligent digital experiences that drive
    innovation and transform businesses.   From prototype to real-world impact – be
    part of a global shift by doing work that matters.Job DescriptionWork together
    with data scientists and analysts to understand the needs for data and create
    effective data pipelinesSolution design, implement, and maintain data pipelines
    for data ingestion, processing, and transformation using could services and
    other technologiesCreate and maintain data solutions IN Azure, using any of the
    following: Data Factory, Synapse, Databricks/Spark, Polars/Pandas,
    Fabric Implementing data validation and cleansing procedures will ensure the
    quality, integrity, and dependability of the data.Improve the scalability,
    efficiency, and cost-effectiveness of data pipelines.Monitoring and resolving
    data pipeline problems, ensuring  consistency and availability of the
    data. QualificationsProficient in Python and SQLKnowledge of good data design
    principles (concepts such as Kimball and Star Schema), data warehousing concepts
    and data modelling.Strong experience with Relational and ideally NoSQL
    databases.Strong understanding of ETL/ELT processes.Exposure to data monitoring
    and observability tools.Relevant experience with Event-Driven ArchitectureGood
    understanding of Agile ways of workingAdditional InformationDiscover some of the
    global benefits that empower our people to become the best version of
    themselves:Finance: Competitive salary package, share plan, company performance
    bonuses, value-based recognition awards, referral bonus;  Career Development:
    Career coaching, global career opportunities, non-linear career paths, internal
    development programmes for management and technical leadership;Learning
    Opportunities: Complex projects, rotations, internal tech communities, training,
    certifications, coaching, online learning platforms subscriptions, pass-it-on
    sessions, workshops, conferences;Work-Life Balance: Hybrid work and flexible
    working hours, employee assistance programme;Health: Global internal wellbeing
    programme, access to wellbeing apps;Community: Global internal tech communities,
    hobby clubs and interest groups, inclusion and diversity programmes, events and
    celebrations.At Endava, we’re committed to creating an open, inclusive, and
    respectful environment where everyone feels safe, valued, and empowered to be
    their best. We welcome applications from people of all backgrounds, experiences,
    and perspectives—because we know that inclusive teams help us deliver smarter,
    more innovative solutions for our customers. Hiring decisions are based on
    merit, skills, qualifications, and potential. If you need adjustments or support
    during the recruitment process, please let us know.