EPAM Global - Αγγελίεσ - Θέσεισ Εργασίσ

lead data software engineer (databricks)

Dec 8, 2024 by 

EPAM Global

Ελλάδα

Ελλάδα

Permanent

Πληροφορική

Remote

Full Time

About the job

We are seeking a Lead Data Software Engineer to join our team and lead the development of our innovative supply-chain data analytic platform.

This platform provides an integrated view of suppliers, products, material categories, shipments, and compliance activities while leveraging artificial intelligence to deliver insights and recommendations tailored to the specific needs of our clients.


If you are interested in this opportunity – apply!

The remote option applies only to the Candidates who will be working from any location in Greece.


#LI-DNI

#LI-YAROSLAVADIAKOVA

Responsibilities

  • Lead the design and development of data architectures and ETL pipelines using Databricks and external orchestrators such as Airflow
  • Collaborate with machine learning teams to integrate AI-driven insights into the platform
  • Implement system-level improvements and components for data engineering
  • Optimize data-intensive applications for performance and scalability
  • Ensure adherence to software engineering best practices, including containerization, unit testing, linting, and code style checks
  • Maintain and enhance data workflow, Delta Lake, and Delta Live Tables within Databricks
  • Provide technical guidance and mentorship to other data engineers in the team
  • Communicate effectively with clients and stakeholders to understand their needs and provide tailored solutions
  • Handle ambiguity and work independently to drive projects to completion

Requirements

  • Experience as a Lead Data Engineer in a project employing Databricks platform
  • Solid understanding of data architectures and data modeling skills
  • Experience designing and building ETL pipelines with Databricks using external orchestrators (e.g., Airflow)
  • Hands-on experience with Databricks (Delta Lake, workflows, Delta Live Tables, deployment, and versioning)
  • Expertise in Python and cloud-native technologies
  • Proficiency in Spark/PySpark
  • Engineering experience with either AWS or Azure
  • Experience with big data and performance optimization of data-intensive applications
  • Strong proactivity, with client-facing experience
  • Ability to deal with ambiguity and drive projects independently
  • Desire to work in a transparent and quickly moving startup environment
  • Fluent English communication skills at a C1 level

Nice to have

  • Experience setting up or maintaining CI/CD pipelines on Azure DevOps
  • Understanding of Data Observability and Data Quality Monitoring
  • Experience integrating data quality checks in data pipelines

We offer

  • For you:
  • Paid annual vacation
  • Paid sick leave days
  • Private health insurance
  • Stable income
  • Meal and home office compensation
  • For your comfortable work:
  • Remote and hybrid work opportunities
  • Corporate laptop
  • Possibility to work on your own device
  • Free licensed software
  • Relocation opportunities
  • Free wellbeing activities
  • For your growth:
  • Possibility to create a Personal Development Plan from the first day in the company
  • Free trainings for technical and soft skills
  • Free access to LinkedIn Learning platform
  • Free access to internal and external e-Libraries
  • Certification opportunities
  • Language courses
  • Internal technical and non-technical communities
  • Possibility to contribute in internal, opensource products

EPAM is a leading global provider of digital platform engineering and development services. We are committed to positively impacting our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to learn and grow continuously. You will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

EPAM is committed to providing our global team of 52,800+ EPAMers with inspiring careers. EPAMers lead with passion and honesty and think creatively. Our people are the source of our success, and we value collaboration, try always to understand our customers' business, and strive for the highest standards of excellence.


Sector

Πληροφορική

Workplace Type

Remote

Employment Type

Permanent

Work Type

Full Time

About the company

Since 1993, EPAM Systems, Inc. (NYSE: EPAM) has used its software engineering expertise to become a leading global provider of digital engineering, cloud and AI-enabled transformation services, and a leading business and experience consulting partner for global enterprises and ambitious startups. We address our clients’ transformation challenges by fusing EPAM Continuum’s integrated strategy, experience and technology consulting with our 30+ years of engineering execution to speed our clients’ time to market and drive greater value from their innovations and digital investments.


We make GenAI real with our AI LLM orchestration, testing and engineering solutions, EPAM DIAL, EPAM EliteA™ and EPAM AI/RUN™, respectively.


We deliver globally, but engage locally with our expert teams of consultants, architects, designers and engineers, making the future real for our clients, our partners and our people around the world.


We believe the right solutions are the ones that improve people’s lives and fuel competitive advantage for our clients across diverse industries. Our thinking comes to life in the experiences, products and platforms we design and bring to market.


Added to the S&P 500 and the Forbes Global 2000 in 2021 and recognized by Glassdoor and Newsweek as a Top 100 Best Workplace, our multidisciplinary teams serve customers across six continents. We are proud to be among the top 15 companies in Information Technology Services in the Fortune 1000 and to be recognized as a leader in the IDC MarketScapes for Worldwide Experience Build Services, Worldwide Experience Design Services and Worldwide Software Engineering Services.




Show More
© Jobily.gr 2024, All rights reserved

When you visit or interact with our sites, services or tools, we or our authorised service providers may use cookies for storing information to help provide you with a better, faster and safer experience and for marketing purposes.

89225f76