lead databricks engineer (relocation to cyprus)
EPAM Global
Ελλάδα
Ελλάδα
Αορίστου
Πληροφορική
Στο χώρο εργασίας
Πλήρης απασχόληση
Περιγραφή Θέσης
We are looking for a Lead Databricks Engineer with expertise in cloud infrastructure, big data processing, data integration and analytics, particularly with Azure.
In this role, you will play a crucial part in advancing our client’s Data-Driven Company initiative within the insurance sector. Your role will involve designing and building robust data architecture to support various aspects of the client’s business.
This position is integral to one of our projects in the client’s Finance IT area, focusing on the integration component of their finance landscape. Proficiency in SQL and Azure Data Factory is essential for success in this role. Join us at our Cyprus office, which offers a flexible hybrid work setup. If you're ready to leverage your skills and perspective to make a significant impact, apply now and help us transform our data capabilities in the finance and insurance industries.
#LI-DNI
Responsibilities
- Data integration, transformation and modeling
- Serving large amounts of structured & semi-structured financial data
- Analyze existing process logic
- Implement best practices in data architecture, including security, governance, compliance and performance optimization
- Optimize the data storage across Delta Lake for data management
- Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity
- Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision-making across the organization
Requirements
- At least 5+ years of professional experience in the data engineering field
- Proficiency in Azure Databricks, Delta Lake, Python and PySpark for data manipulation
- Proficiency in designing and optimizing pipelines using Azure Data Factory, including performance tuning and optimizing data pipelines with Databricks Notebooks
- Experience with Azure data platforms and related services
- Good understanding of SQL and experience with relational database systems (e.g., MSSQL, PostgreSQL, Oracle DB)
- Understanding data structures, data modeling and data architecture patterns (Data Lake, DWH, Data mesh, etc.)
- Ability to work in an agile environment and eager to learn and develop new skills
- Good problem-solving skills and attention to detail
- Strong written and spoken English
Nice to have
- Certifications in Azure data or Cloud Services (e.g., Azure Data Engineer Associate)
- Business understanding of the insurance or financial domain
- Experience with BI Tools (Power BI)
We offer
- Private healthcare insurance
- Regular performance assessments
- Family friendly initiatives
- Corporate Programs including Employee Referral Program with rewards
- Learning and development opportunities including in-house training and coaching, professional certifications, over 22,000 courses on LinkedIn Learning Solutions and much more
- *All benefits and perks are subject to certain eligibility requirements
Τομέας
Πληροφορική
Χώρος Εργασίας
Στο χώρο εργασίας
Σύμβαση Χρόνου
Αορίστου
Τύπος εργασίας
Πλήρης απασχόληση
Περιγραφή Εταιρείας
Since 1993, EPAM Systems, Inc. (NYSE: EPAM) has used its software engineering expertise to become a leading global provider of digital engineering, cloud and AI-enabled transformation services, and a leading business and experience consulting partner for global enterprises and ambitious startups. We address our clients’ transformation challenges by fusing EPAM Continuum’s integrated strategy, experience and technology consulting with our 30+ years of engineering execution to speed our clients’ time to market and drive greater value from their innovations and digital investments.
We make GenAI real with our AI LLM orchestration, testing and engineering solutions, EPAM DIAL, EPAM EliteA™ and EPAM AI/RUN™, respectively.
We deliver globally, but engage locally with our expert teams of consultants, architects, designers and engineers, making the future real for our clients, our partners and our people around the world.
We believe the right solutions are the ones that improve people’s lives and fuel competitive advantage for our clients across diverse industries. Our thinking comes to life in the experiences, products and platforms we design and bring to market.
Added to the S&P 500 and the Forbes Global 2000 in 2021 and recognized by Glassdoor and Newsweek as a Top 100 Best Workplace, our multidisciplinary teams serve customers across six continents. We are proud to be among the top 15 companies in Information Technology Services in the Fortune 1000 and to be recognized as a leader in the IDC MarketScapes for Worldwide Experience Build Services, Worldwide Experience Design Services and Worldwide Software Engineering Services.
Περισσότερα