senior data engineer (data pipeline testing)
CHUBB
Θεσσαλονίκη
Θεσσαλονίκη
Permanent
Πληροφορική
Hybrid
Full Time
About the job
Responsibilities:
Collaborate with cross-functional teams to understand data requirements and define testing strategies for data quality assurance.
Develop and execute test plans, test cases, and test scripts to validate data pipelines and identify potential issues.
Perform extensive data analysis to identify anomalies, inconsistencies, and gaps in data quality.
Work closely with data engineering and data science teams to remediate data quality issues and improve data integrity.
Continuously monitor and evaluate the effectiveness of data quality processes and make recommendations for improvements.
Contribute to the automation of data quality tests and processes using SQL scripts, Python, and PySpark.
Collaborate with software developers in troubleshooting and resolving data-related issues.
Implement data quality standards and processes and tools to ensure that data meets those requirements.
Qualifications
Qualifications
Bachelor's degree in Computer Science, Information Systems, or a related field.
Minimum of 7 years of experience as a Data Engineer, Tester, or in a similar role.
Strong knowledge of SQL, Python or Java, Spark, Manual and Automated Testing (within ETL/Data Engineering contexts)
Experience with testing real-time/streaming data pipelines (e.g. via Kafka)
Clear hands-on experience with database systems - Cloud technologies (e.g. AWS, Azure, Google), database systems - traditional RDBMS (e.g. Teradata, SQL Server, Oracle), and NoSQL databases (e.g. Cosmos, MongoDB, DynamoDB), Analytical datastore (e.g. Synapse & Snowflake)
Exposure to DQ tools (e.g. Talend Data Quality, Oracle EDQ, Informatica IDMC, IBM InfoSphere QualityStage) as well as more recent big data tools
Deep understanding of data quality concepts and best practices, including data profiling, data cleansing, data matching, and data governance.
Ability to define and implement data quality standards for different types of data and systems.
Ability to work with stakeholders to understand data quality needs and priorities, and to develop and implement data quality solutions that meet those needs.
Ability to coach and mentor junior data quality engineers and educate on best practices
Ability to stay up-to-date on the latest trends and best practices in data quality.
Excellent communication and collaboration skills.
Critical Thinking
Our team makes a difference, every time. For this reason, we offer in return!
We offer hybrid working model, explicit, structured career development, a competitive salary package, annual bonus, private medical cover, monthly allowance for lunch, continuous learning experiences, work in a fun, lively environment with mentoring from our ground-breaking senior mentors.
Integrity. Client Focus. Respect. Excellence. Teamwork
Our core values instruct how we live and work. We’re an ethical and honest company that’s wholly committed to its clients. A business that’s engaged in mutual trust and respect for its employees and partners. A place where colleagues perform at the highest levels. And a working environment that’s collaborative and encouraging.
Diversity & Inclusion
At Chubb, we consider our people our chief competitive advantage and as such we treat colleagues, candidates, clients, and business partners with equality, fairness, and respect, regardless of their age, disability, race, religion or belief, gender, sexual orientation, marital status or family circumstances. We strive to achieve an environment where all colleagues feel comfortable performing to their full potential and are recognized for their contributions.
Many voices, One Chubb!
Sector
Πληροφορική
Workplace Type
Hybrid
Employment Type
Permanent
Work Type
Full Time
About the company
Chubb is the world’s largest publicly traded property and casualty insurer operating in 54 countries, Chubb is making significant investments to thrive in a digital age. Chubb launched its third Technology Hub in Thessaloniki in 2022 which is rapidly developing. Our new center of excellence in Greece is positioned to drive our ongoing business and to support our digital business transformation, as well as the company's operations in the European region which encompasses 27 countries
Show More