Εμπόριο Λιανικής

Πληροφορική

Κατασκευαστικός Κλάδος / Τεχνικά Επαγγέλματα

Χρηματοοικονομικά

Αποθήκη / Logistics

Κέντρο Εξυπηρέτησης / Call Center

Εταιρικές Πωλήσεις

Επαγγέλματα Υγείας

Διοίκηση Επιχειρήσεων

Εστίαση

Βιομηχανική Παραγωγή

Άλλο

Μεταφορές

Γραμματειακή Υποστήριξη

Marketing

Ανθρώπινο Δυναμικό / HR

Ναυτιλία

Αερομεταφορές

Νομικές Υπηρεσίες

Εκπαίδευση

Φροντίδα Κτιρίων / Σπιτιών

Αισθητική / Κομμωτήριο

ΜΜΕ / Social Media

Τηλεπικοινωνίες

Φροντίδα Ζώων

Προσωπικό Ασφαλείας

Εργάτες

Τουρισμός / Ξενοδοχεία

Αθλητισμός / Fitness

Φροντίδα Ενήλικων / Παιδιών

Τέχνες / Πολιτισμός

LastWeek

LastThreeDays

Today

Aoristou

Internship

Orismenou

FullTime

Hybrid

OnSite

Remote

Our client is a premier software development firm specializing in the delivery of large-scale ICT projects tailored for the public sector. Their company was founded with a mission to transform public services through the strategic implementation of cutting-edge technology. With a profound understanding of the unique needs and challenges faced by government agencies, they are committed to providing solutions that drive efficiency, transparency, and enhanced citizen engagement.Their core services include custom software development, ICT project management, system integration, cybersecurity, cloud solutions, and data analytics. Each service is meticulously designed to meet the specific requirements of public sector organizations.Their company stands out due to their extensive experience and proven track record in the public sector. They have successfully implemented numerous large-scale projects, each driving significant improvements in service delivery and operational efficiency.The role:<ul><li>Developing and delivering high-quality, scalable front-end features using Angular and TypeScript, from concept to deployment</li><li>Producing clean, maintainable, and testable code following best practices and internal standards</li><li>Ensuring high performance and responsiveness of web applications</li><li>Implementing secure coding principles and contributing to code reviews</li><li>Refactoring existing code and optimizing for performance</li><li>Debugging and resolving issues across the full front-end framework</li></ul><h2>Requirements:</h2><ul><li>BSc in Computer Science or a related field</li><li>3-6 years of experience in developing web applications using Angular and TypeScript</li><li>Strong understanding of modern front-end architecture and design patterns</li><li>Experience building scalable, stateless Single Page Applications (SPAs)</li><li>Proficiency in consuming and integrating RESTful APIs</li><li>Experience with version control tools (preferably Git)</li><li>Strong understanding of responsive design and cross-browser compatibility issues</li><li>Ability to work effectively within a collaborative team environment</li></ul>Preferred but not mandatory:<ul><li>Experience with RxJS, NgRx or similar state management libraries</li><li>Familiarity with OWASP web security guidelines</li><li>Experience with Java or .NET environments</li><li>Hands-on experience with agile methodologies and tools like Jira or Azure DevOps</li><li>Knowledge of CI/CD pipelines and automated testing (Jasmine, Karma, Cypress)</li></ul><h2>What they offer:</h2><ul><li>Hybrid working model</li><li>Competitive compensation package</li><li>Continuous professional development and training</li><li>Friendly, dynamic, and collaborative work environment</li><li>Engagement in impactful, large-scale public sector projects</li></ul>

Mid/Senior Angular Developer

Our FinTech project is the second-largest Greek bank by total assets and the largest by market capitalization of €2.13 billion. It has a subsidiary and branch in London, England and subsidiaries in Albania, Cyprus and Romania.Qualifications:<ul><li>Bachelors degree in IT, Computer Science or any relevant field</li><li>3+ years experience to different application development approaches</li><li>Working experience with Spring ecosystem (Spring Boot, Data, Security, Batch, etc)</li><li>Familiarity with JPA/Hibernate</li><li>Experience with REST APIS</li><li>Experience with Apache Camel</li><li>Experience with Maven, Docker, Kubernetes, Openshift, Message brokers (RabbitMQ, Kafka)</li><li>Familiar with Devops tools (Jenkins, Azure DevOps, ArgoCD)</li><li>Eagerness to contribute in a team-oriented environment</li><li>Ability to work creatively and analytically in a problem-solving environment</li></ul>Let’s talk about us:<ul><li>Hybrid working model</li><li>A competitive salary</li><li>Signing Bonus</li><li>Brand new equipment</li><li>Exciting &amp; friendly work environment</li><li>Career &amp; competencies’ development</li><li>Continuous learning &amp; development experience based on infinity model through Code.Hub’s Code.Learn</li><li>L&amp;D plan for your career improvement</li><li>A truly open, inclusive, and competitive-free environment to grow your skills and have fun!</li><li>Internal competitions &amp; rewards.</li></ul>Let’s talk about Code.Hub-ers:<ul><li>You are eligible to free LinkedIn trainings</li><li>You are eligible to have free pass to all training Code.Learn activities after 6 months from your induction</li><li>Training &amp; Tech Mentor for your induction.</li><li>Unlimited access to LinkedIn Learning platform (1st semester).</li><li>Sponsoring of a Bachelor and/or Master’s Degree from Athens Tech College.</li><li>Private Health Insurance.</li><li>Performance planning each six months and each two years planning of promotion.</li><li>Free Lunch/Snack every day &amp; Cocktail Fridays @ our offices.</li><li>Referral Bonus.</li></ul>

Middleware Java Engineer NEW

We are looking for an enthusiastic Junior Data Scientist to join the activities of our team. The candidate will have the opportunity to work on cutting edge projects by performing in-depth analysis on big data. The successful candidate will join a friendly team of leading experts in the field of Data Science and expand their knowledge in a pleasant and inspiring environment.<h2>The main responsibilities of the position include:</h2><ul><li></li></ul><ul><li>Execute queries in both relational and non-relational databases.</li><li>Perform data cleansing and preprocessing.</li><li>Analyze and resolve data issues.</li><li>Perform ad-hoc reporting where is needed</li><li>Collaborate with cross-functional teams to understand business requirements.</li><li>Performing exploratory data analysis to identify patterns and trends.</li><li>Assess the performance of the models developed by the Data Scientists</li><li>Communicate results with the rest of the team&nbsp;</li></ul><h2>Main requirements:</h2><ul><li></li></ul><ul><li>University degree in Computer Science, Data Science or related field.</li><li>At least 1 year of experience with Python-based libraries, such as Pandas, NumPy and Polars for data wrangling and preprocessing.</li><li>Strong foundation in Python, with the ability to write clean and efficient code for production-ready projects and scalable solutions.</li><li>Fundamental knowledge or exposure to Machine Learning and Natural Language Processing (NLP) concepts.</li><li>Experience with data visualization tools and libraries in Python (e.g., Matplotlib, Seaborn, Plotly).</li><li>Willingness to learn and stay up to date with emerging data science trends and new technologies.</li><li>High attention to detail.</li><li>Ability to work in a team.</li><li>Strong analytical and problem-solving skills.</li><li>Self–motivation and passion to work with data.</li><li>Eagerness for continuous professional development.</li><li>Excellent verbal and written communication skills in English.</li></ul><h2>The following will be considered an advantage:</h2><ul><li></li></ul><ul><li>Familiarity with SQL queries. Experience with MongoDB queries and the aggregation framework.</li><li>Familiarity with Unix/Linux.</li><li>Basic understanding of AWS services</li></ul><h2>Benefit from:</h2><ul><li></li></ul><ul><li>Attractive remuneration package</li><li>Private health insurance</li><li>Corporate pension fund</li><li>Intellectually stimulating work environment</li><li>Continuous personal development and international training opportunities</li></ul><h2></h2>

Junior Data Scientist

We are seeking for skilled and motivated Data Engineers to join our dynamic Business Intelligence and Data Science teams. The successful candidates will work with leading experts on cutting-edge projects relating to the definition and development of efficient big data structures, data cleansing techniques and design and optimisation of data infrastructure and pipelines.&nbsp;&nbsp;<h2>The main responsibilities of the position include:</h2><ul><li></li></ul><ul><li>Understand data requirements and develop efficient data models and structures.</li><li>Design, build, and maintain scalable and reliable data structures, pipelines and processes.</li><li>Execute queries in both relational and non-relational databases.</li><li>Collaborate with cross-functional teams to define and enforce data governance policies and data security best practices.</li><li>Monitor, troubleshoot and resolve issues regarding data quality, data pipeline failures, and data infrastructure.&nbsp;</li><li>Stay up to date with emerging trends and technologies in the data engineering and data management field and recommend innovative solutions to enhance our data infrastructure and processes.</li><li> </li></ul><h2>Main requirements:</h2><ul><li></li></ul><ul><li>BSc/MSc in Computer Science, Physics/Science, Engineering, Mathematics or other relevant field</li><li>Experience in data manipulation and big-data processing frameworks will be considered an advantage</li><li>Good knowledge of SQL and experience with relational databases will be considered an advantage</li><li>Familiarity with ETL processes, data warehousing concepts, and related technologies will be considered an advantage</li><li>Programming experience with Python or any high-level programming language will be considered an advantage</li><li>Experience with Unix/Linux will be considered an advantage</li><li>Good knowledge of data visualisation techniques</li><li>Self-motivation and passion for working with data</li><li>Eagerness for continuous professional development</li><li>Excellent problem-solving and analytical skills with attention to detail</li><li>Strong communication and collaboration skills to work effectively in a team environment</li><li>Excellent verbal and written communication skills in English</li></ul><h2>Benefit from:</h2><ul><li></li></ul><ul><li>Attractive remuneration package</li><li>Private health insurance</li><li>Corporate pension fund</li><li>Intellectually stimulating work environment</li><li>Continuous personal development and international training opportunities</li></ul><h2></h2>

Data Engineer

As our new Senior PHP Developer, you will join an amazing team who is dedicated to taking the next step in software engineering. You will make key decisions on software processes, and use Kubernetes and Terraform on PHP, Go, React &amp; Angular on AWS. The team will keep you up-to-date with the latest technology stacks and processes and help you see challenging projects from beginning to end.<h2>The main responsibilities of the position include:</h2><ul><li></li></ul><ul><li>Design and implement new features/projects</li><li>Maintain and refactor existing web applications such as the company's website, registration forms, Members Area and internal web services</li><li>Research and integrate new web technologies</li><li>Write tests that will run on a continuous integration server 24/7 to ensure code testability, code coverage and quality conforms to the company’s highest standards</li><li>Resolve support tickets for IT related issues</li></ul><h2>Main requirements:</h2><ul><li></li></ul><ul><li>BSc/MSc in Information Technology or any other relevant degree</li><li>At least 3 years of experience in a similar position</li><li>Very good knowledge of PHP 7+, MySQL, Redis, Git</li><li>Experience in creating and consuming web services</li><li>Experience with modern PHP frameworks</li><li>Experience in writing tests with PHPUnit</li><li>Ability to research and adapt new web technologies that add value to the team</li><li>Strong organisational skills with the ability to multitask and prioritise</li><li>Problem solving and analytical skills</li><li>Ability to work independently and integrate well within a team</li></ul><h2>The following will be considered an advantage:</h2><ul><li></li></ul><ul><li>Experience in Symfony framework</li><li>Experience in the development of REST APIs</li><li>Experience in software development practices like design patterns, SOLID principles, DRY</li><li>Very good understanding of security practices (OWASP)</li><li>Experience with cloud providers (e.g. AWS)</li><li>Experience in database query optimization</li><li>Experience in creating composer packages</li><li>Experience in front-end frameworks or libraries like Angular or React</li></ul><h2>Benefit from:</h2><ul><li></li></ul><ul><li>Attractive remuneration package</li><li>Intellectually stimulating work environment</li><li>Continuous personal development and international training opportunities</li><li> </li></ul>

Senior PHP Web Developers

We are seeking a Data Governance Officer – Team Lead to promote a culture of accountability, stewardship, and continuous improvement in data usage across the organization. This role positions data as a strategic asset that supports informed decision-making and drives operational excellence.<h2>The main responsibilities of the position include:</h2><ul><li></li></ul><ul><li>Define strategic objectives, a clear roadmap, and KPIs for the department in line with corporate goals</li><li>Develop specific actions to achieve agreed targets and KPIs</li><li>Ensure all governance documentation—policies, principles, standards, and procedures—are current and relevant</li><li>Coordinate governance activities with Data Quality Engineers, IT Architecture teams, and other stakeholders across the organisation</li><li>Implement robust data processes and guidelines and ensure adherence</li><li>Act as the escalation point for data accuracy issues and drive effective resolutions</li><li>Maintain and manage business metadata definitions, business rules, and organisation-wide reference data</li><li>Support the implementation, rollout, and development of the Data Catalogue and manage change control for metadata</li><li>Promote and lead the adoption of consistent data definitions and best practices through training, communications, and workshops</li><li>Advise the Security Team to ensure data receives appropriate protection in line with classification</li><li>Report on data governance maturity and performance metrics</li><li>Set personal targets for team members, monitor performance, and provide constructive feedback</li><li>Coach and develop team members, sharing knowledge and fostering a culture of collaboration and growth</li><li>Motivate the team and encourage idea-sharing to improve individual and team performance</li></ul><h2>Main requirements:</h2><ul><li></li></ul><ul><li>BSc/MSc in Information Technology or equivalent</li><li>Minimum 5 years’ experience in data stewardship/management or a similar role</li><li>Possession of professional certifications such as CDS, CDMP, or DGSP</li><li>Hands-on experience with data catalogues, data warehouses, and/or MDM solutions</li><li>Excellent stakeholder engagement skills across all organisational levels</li><li>Strong communication, collaboration, and leadership abilities</li><li>Deep understanding of Data Governance concepts and GDPR compliance</li><li>Good knowledge of data quality processes and remediation activities</li><li>Ability to manage large datasets, identify errors, and implement solutions</li><li>Strong analytical skills with the ability to inspire and mobilise teams</li><li>Proven ability to coach, train, and develop team members</li><li>Occasional travel to support projects at different offices abroad</li></ul><h2>Benefit from:</h2><ul><li></li></ul><ul><li>Attractive remuneration package plus performance related reward</li><li>Intellectually stimulating work environment</li><li>Continuous personal development and international training opportunities</li></ul><h2></h2>

Data Governance Officer – Team Lead

Our Client is seeking an Application Support Engineer with experience in operational support of production environments and strong technical understanding of software applications. The ideal candidate will be responsible for monitoring, troubleshooting, and resolving issues related to the performance and operation of critical applications within a 24/7 support framework.Key Responsibilities<ul><li>Monitoring the operation of production applications using monitoring tools. </li><li>Reading and analyzing application logs. </li><li>Administering Kubernetes clusters. </li><li>Collaborating with development teams for debugging and reproducing issues. </li><li>Performing health checks, restarting services, scaling pods. </li><li>Participating in a 24/7 rotating shift schedule. </li><li>Documenting actions and communicating incidents.</li></ul>Required Skills &amp; Experience<ul><li>1–3 years of experience in Application Support / DevOps Support. </li><li>Experience in reading logs. </li><li>Experience with monitoring tools. </li><li>Hands-on experience in Kubernetes administration. </li><li>Understanding of CI/CD, containers, and microservices. </li><li>Strong troubleshooting skills. </li><li>Good knowledge of Linux. </li><li>Good command of the English language.</li></ul>Nice-to-Have Qualifications<ul><li>Experience with ticketing systems. </li><li>Basic SQL knowledge or API troubleshooting experience. </li><li>Team spirit and responsibility.</li></ul>Working Schedule<ul><li>24/7 rotating shifts with shift compensation and the option for remote support.</li></ul>They Offer<ul><li>Participation in high-tech projects. </li><li>Access to modern monitoring &amp; observability tools. </li><li>Continuous training. </li><li>Competitive compensation and benefits package.</li></ul>

Application Support Engineer NEW

Our Client is seeking an experienced Senior AI Engineer&nbsp;with deep expertise in&nbsp;LangChain&nbsp;and modern&nbsp;LLM frameworks. You will lead the development of advanced LLM-driven applications, design complex&nbsp;RAG architectures, and guide the team in best practices for LLM engineering. Key Responsibilities LangChain &amp; LLM Development<ul><li>Design and develop advanced applications using&nbsp;LangChain, LangGraph, and LangSmith</li><li>Build complex&nbsp;chains, agents, and multi-agent systems</li><li>Implement&nbsp;custom tools, retrievers, and memory systems</li><li>Develop context-aware&nbsp;conversational AI and chatbot applications</li><li>Create workflow orchestration using&nbsp;LangGraph&nbsp;for complex reasoning tasks</li><li>Integrate multiple LLM providers (OpenAI, Anthropic, Cohere, Azure OpenAI)</li><li>Optimize&nbsp;prompt templates&nbsp;and&nbsp;output parsers</li></ul>RAG &amp; Vector Database Architecture<ul><li>Design and implement advanced&nbsp;Retrieval-Augmented Generation (RAG)&nbsp;systems</li><li>Develop custom&nbsp;embedding strategies&nbsp;and&nbsp;chunking techniques</li><li>Work with vector databases such as&nbsp;Pinecone, Weaviate, Chroma, Qdrant, Milvus</li><li>Implement&nbsp;hybrid search&nbsp;(semantic + keyword) and&nbsp;reranking&nbsp;methods</li><li>Build document loaders and text splitters for diverse data sources</li><li>Optimize retrieval quality with&nbsp;metadata filtering&nbsp;and&nbsp;query expansion</li><li>Develop&nbsp;multi-modal RAG systems&nbsp;(text, images, documents)</li></ul>Advanced LLM Techniques<ul><li>Apply advanced prompt engineering:&nbsp;few-shot,&nbsp;chain-of-thought,&nbsp;ReAct</li><li>Build&nbsp;function calling&nbsp;and tool-use patterns</li><li>Develop structured output with&nbsp;Pydantic models</li><li>Implement&nbsp;streaming responses&nbsp;and async pipelines</li><li>Build efficient&nbsp;caching strategies&nbsp;for cost optimization</li><li>Implement&nbsp;fallback mechanisms&nbsp;and robust error handling</li><li>Integrate&nbsp;guardrails&nbsp;and content moderation systems</li></ul>Production &amp; Monitoring<ul><li>Deploy LangChain applications to production using&nbsp;LangServe</li><li>Integrate&nbsp;LangSmith&nbsp;for tracing, debugging, and evaluation</li><li>Implement monitoring and observability for LLM applications</li><li>Build evaluation frameworks for quality assurance</li><li>Optimize latency, cost, and token usage</li><li>Run&nbsp;A/B testing&nbsp;for prompt variations</li><li>Create dashboards to monitor key LLM metrics</li></ul>Required Qualifications Education<ul><li>Bachelor’s degree in Computer Science, Machine Learning, or related field (required)</li><li>Master’s degree in AI/ML or Computer Science (preferred)</li></ul>Experience<ul><li>5+ years of software development experience</li><li>3+ years working with AI/ML and LLM applications</li><li>2+ years hands-on experience with&nbsp;LangChain&nbsp;(mandatory)</li><li>Proven experience building&nbsp;production-grade LLM applications</li><li>Strong background with&nbsp;RAG architectures&nbsp;and vector databases</li></ul>Technical Skills – LangChain Ecosystem &nbsp;LangChain Core (Required)<ul><li>Expert-level knowledge of&nbsp;LangChain (v0.1+)</li><li>Deep understanding of Chains, Agents, Tools, Memory, Callbacks</li><li>Experience with&nbsp;LangChain Expression Language (LCEL)</li><li>Knowledge of&nbsp;LangGraph&nbsp;for complex workflows</li><li>Familiarity with&nbsp;LangSmith&nbsp;for monitoring/debugging</li><li>Experience deploying with&nbsp;LangServe</li><li>Understanding of&nbsp;LangChain Templates</li></ul>LLM Providers &amp; APIs<ul><li>Strong experience with&nbsp;OpenAI API&nbsp;(GPT-4, GPT-3.5, embeddings)</li><li>Knowledge of&nbsp;Anthropic Claude API</li><li>Familiarity with&nbsp;Azure OpenAI Service</li><li>Experience with open-source models (Llama, Mistral, Mixtral)</li><li>Knowledge of&nbsp;Hugging Face Inference API</li><li>Understanding model capabilities, limitations, and pricing models</li></ul>Vector Databases &amp; Embeddings<ul><li>Hands-on experience with&nbsp;Pinecone, Weaviate, or Chroma</li><li>Knowledge of embedding models (OpenAI, Cohere, sentence-transformers)</li><li>Understanding similarity search algorithms</li><li>Experience with metadata filtering and hybrid search</li><li>Knowledge of vector indexing strategies (HNSW, IVF)</li></ul>Programming &amp; Software Engineering<ul><li>Expert-level Python (asyncio, type hints, Pydantic)</li><li>Experience with&nbsp;FastAPI</li><li>Strong understanding of async/await patterns</li><li>Strong software engineering fundamentals</li><li>Experience with Git, CI/CD, testing frameworks</li></ul>&nbsp;Cloud &amp; Infrastructure<ul><li>Experience with AWS (Lambda, ECS, S3, DynamoDB) or Azure</li><li>Docker containerization</li><li>Kubernetes (preferred)</li><li>Serverless architectures</li><li>API Gateway and load balancing</li></ul>Core Capabilities<ul><li>Deep understanding of LLM capabilities and limitations</li><li>Expertise in prompt engineering and optimization</li><li>Ability to design scalable LLM architectures</li><li>Strong understanding of cost optimization for LLM workloads</li><li>Knowledge of AI safety and responsible AI practices</li><li>Excellent problem-solving and communication skills</li></ul>Preferred Qualifications<ul><li>Contributions to LangChain or other open-source LLM projects</li><li>Experience with LlamaIndex, Haystack, or similar frameworks</li><li>Knowledge of fine-tuning (LoRA, QLoRA)</li><li>Experience with multi-agent systems and AutoGPT patterns</li><li>Knowledge of semantic caching and query optimization</li><li>Experience with document intelligence and OCR</li><li>Understanding transformer architectures</li><li>Experience with evaluation frameworks (RAGAS, TruLens)</li><li>Experience with streaming and real-time LLM processing</li><li>Blog posts, tutorials, or presentations on LangChain</li><li>Cloud certifications</li></ul>What They Offer<ul><li>Highly competitive salary and equity package</li><li>Full health, dental, and vision insurance</li><li>Generous budget for professional development and certifications</li><li>Flexible working arrangements (remote/hybrid options)</li><li>Access to cutting-edge AI infrastructure and LLM APIs</li><li>Collaborative environment with world-class AI professionals</li><li>Participation in conferences and AI community events</li><li>Opportunities for technical leadership and mentorship</li><li>Influence over the company’s AI strategy</li></ul>&nbsp;Success Metrics Success in this role will be measured by:<ul><li>Quality and performance of LangChain applications</li><li>Reduction in latency and improved cost efficiency</li><li>Accuracy and relevance of RAG systems</li><li>Adoption of best practices across the team</li><li>Speed of delivery for new AI features</li><li>User satisfaction with AI-powered features</li><li>Technical leadership and mentorship impact</li><li>Contribution to documentation and knowledge base</li></ul>Technologies You Will Work With LLM Frameworks<ul><li>LangChain, LangGraph, LangSmith, LangServe</li><li>OpenAI API, Anthropic Claude API</li><li>Hugging Face Transformers</li></ul>Vector Databases<ul><li>Pinecone, Weaviate, Chroma, Qdrant</li><li>PostgreSQL with pgvector</li></ul>Development Stack<ul><li>Python 3.11+, FastAPI, Pydantic</li><li>Docker, Kubernetes</li><li>AWS/Azure cloud services</li><li>Git, GitHub Actions</li></ul>Monitoring &amp; Observability<ul><li>LangSmith</li><li>Prometheus, Grafana</li><li>DataDog, New Relic</li></ul>

AI Engineer – LangChain & LLM Frameworks Specialist

Our Client is seeking a detail-oriented LLM Quality Analyst to join their AI team. You will be responsible for designing, implementing, and managing comprehensive testing and evaluation frameworks for their generative AI products. This role is critical to ensuring their AI systems meet the highest standards of quality, accuracy, safety, and ethical compliance before reaching production.Key ResponsibilitiesTesting Framework Development<ul><li>Design and implement comprehensive testing frameworks for LLM and generative AI applications</li><li>Create curated benchmark suites using industry-standard datasets (TruthfulQA, ARC, TriviaQA, MMLU)</li><li>Develop custom evaluation datasets tailored to specific use cases and domains</li><li>Build synthetic data generation pipelines for edge case testing</li><li>Define clear evaluation criteria, rubrics, and quality metrics</li><li>Establish testing protocols for different AI model types and applications</li></ul>Quality Evaluation &amp; Testing<ul><li>Execute automated and manual evaluations of AI model outputs</li><li>Measure and track key quality metrics: relevance, factual consistency, coherence, hallucination rate</li><li>Assess model performance across dimensions: accuracy, latency, fairness, toxicity, bias</li><li>Perform functional correctness testing for code generation and structured outputs</li><li>Conduct A/B testing and shadow testing for model comparisons</li><li>Validate prompt engineering strategies and RAG pipeline effectiveness</li></ul>Feedback Management &amp; Issue Tracking<ul><li>Manage intake of user-reported issues and feedback</li><li>Translate user feedback into reproducible test cases</li><li>Replicate and document bugs, edge cases, and failure modes</li><li>Log and track defects in issue-tracking systems (Jira, Linear, GitHub Issues)</li><li>Prioritize issues based on severity, frequency, and business impact</li><li>Collaborate with engineering teams on root cause analysis and resolution</li></ul>Human Annotation &amp; LLM-Based Evaluation<ul><li>Coordinate human annotation efforts with clear guidelines and rubrics</li><li>Implement overlapping review processes to ensure annotation consistency</li><li>Integrate LLM-based evaluators (GPT-4, Claude) for automated quality assessment</li><li>Design evaluation prompts that provide structured scores and reasoning</li><li>Validate LLM evaluator outputs against human judgments</li><li>Continuously refine evaluation methodologies based on findings</li></ul>Monitoring &amp; Reporting<ul><li>Monitor live-traffic metrics through observability dashboards</li><li>Track model performance trends and identify quality regressions</li><li>Generate comprehensive quality reports for product and engineering teams</li><li>Present findings and recommendations to stakeholders</li><li>Maintain documentation of testing procedures and evaluation results</li><li>Drive continuous improvement of AI system quality</li></ul>Required QualificationsEducation<ul><li>Bachelor’s degree in Computer Science, Data Science, Linguistics, Cognitive Science, or related field</li><li>Master’s degree in AI/ML, NLP, or related field (preferred)</li></ul>Experience<ul><li>3+ years of experience in quality assurance, testing, or evaluation roles</li><li>2+ years working with AI/ML systems, preferably LLMs or NLP applications</li><li>Experience designing and executing test plans for software or AI products</li><li>Proven track record of identifying and documenting complex technical issues</li></ul>Technical Skills<ul><li>Programming: Proficiency in Python for test automation and data analysis</li><li>LLM Knowledge: Understanding of how LLMs work, their capabilities and limitations</li><li>Evaluation Frameworks: Familiarity with LLM evaluation tools (Langfuse, DeepEval, RAGAS, Phoenix)</li><li>Data Analysis: Experience with pandas, numpy, and data visualization tools</li><li>Testing Tools: Knowledge of pytest, unittest, or similar testing frameworks</li><li>Issue Tracking: Proficiency with Jira, Linear, GitHub Issues, or similar platforms</li><li>APIs: Ability to work with REST APIs and LLM provider APIs (OpenAI, Anthropic)</li><li>SQL: Basic SQL skills for querying databases and analyzing results</li></ul>Quality Assurance Expertise<ul><li>Strong understanding of QA methodologies and best practices</li><li>Experience with test case design and test coverage analysis</li><li>Knowledge of different testing types: functional, regression, integration, performance</li><li>Familiarity with CI/CD pipelines and automated testing integration</li><li>Understanding of metrics and KPIs for quality measurement</li></ul>AI/ML Evaluation Knowledge<ul><li>Understanding of common LLM evaluation metrics (BLEU, ROUGE, BERTScore, perplexity)</li><li>Knowledge of bias detection and fairness evaluation techniques</li><li>Familiarity with hallucination detection and factual consistency checking</li><li>Understanding of prompt engineering and its impact on model outputs</li><li>Awareness of AI safety, ethics, and responsible AI principles</li></ul>Core Competencies<ul><li>Exceptional attention to detail and analytical thinking</li><li>Strong problem-solving and critical reasoning abilities</li><li>Excellent written and verbal communication skills</li><li>Ability to work independently and manage multiple priorities</li><li>Collaborative mindset for cross-functional teamwork</li><li>Curiosity and willingness to learn new AI technologies</li></ul>Preferred Qualifications<ul><li>Experience with specific LLM evaluation platforms (Langfuse, Weights &amp; Biases, Arize)</li><li>Knowledge of human-in-the-loop evaluation workflows</li><li>Familiarity with RAG systems and vector database evaluation</li><li>Experience with adversarial testing and red-teaming for AI systems</li><li>Understanding of model fine-tuning and its quality implications</li><li>Background in linguistics, cognitive science, or human-computer interaction</li><li>Experience with statistical analysis and hypothesis testing</li><li>Knowledge of regulatory requirements (GDPR, AI Act) for AI systems</li><li>Contributions to AI evaluation research or open-source projects</li><li>Experience with multimodal AI evaluation (text, image, audio)</li></ul>What They Offer<ul><li>Competitive salary and benefits package</li><li>Comprehensive health, dental, and vision insurance</li><li>Professional development opportunities in AI/ML</li><li>Flexible work arrangements (remote/hybrid options)</li><li>Access to cutting-edge AI technologies and tools</li><li>Collaborative team environment with AI experts</li><li>Opportunity to shape quality standards for innovative AI products</li><li>Conference attendance and learning budget</li></ul>&nbsp;

AI Engineer (LLM Quality Analyst)

Our Client is&nbsp; looking for a passionate and experienced software engineer to lead impactful projects/products and participate in the evolution of their Java Chapter . The successful candidate will play a key role in designing, implementing, and mentoring within a cross-functional software development unit, delivering high-quality solutions for their projects.Key Responsibilities:<ul><li>Lead and mentor the Backend Chapter, fostering a culture of collaboration and technical excellence.</li><li>Participate in the design and architecture of backend systems at both high-level and detailed levels.</li><li>Oversee code reviews to ensure best practices, scalability, and performance.</li><li>Contribute to project planning, estimations, and delivery timelines.</li><li>Collaborate closely with cross-functional teams to align technical solutions with business needs.</li><li>Drive continuous improvement in coding standards, tools, and processes.</li></ul>Required Skills:<ul><li>University degree (or higher education institute) in Computer Science, Information Technology, or a relevant field.</li><li>5+ years of hands-on experience in backend development.</li><li>Strong knowledge of Java.</li><li>Practical experience with Spring, Spring Boot, and Hibernate frameworks.</li><li>Solid experience with relational databases such as MySQL or PostgreSQL.</li><li>Excellent communication skills (oral and written).</li><li>Strong leadership and teamwork abilities.</li></ul>Desired Skills:<ul><li>Familiarity with JavaScript frameworks.</li><li>Proficiency with build tools such as Gradle, Ant, or Maven.</li><li>Experience with ElasticSearch or caching engines (e.g., Redis).</li><li>Hands-on experience with testing tools and frameworks such as JMeter, Selenium, or Spock.</li></ul>What You Can Expect:At their company, you’ll lead projects that make a real impact and work within an environment that values innovation and technical excellence. They foster knowledge sharing, experimentation, and continuous improvement to stay ahead in technology and product quality.At their company, they&nbsp; follow a chapter structure to ensure continuous improvement and innovation. Their Java Chapter meets regularly to discuss emerging trends and technologies, ensuring they stay at the forefront of the tech world. They take ownership in evolving their tech stack to remain competitive and innovative, continuously refining their tools and processes to meet future demands.

Backend Technical Leader (Java Chapter)

Job Ads Αττική - Page 5

mid/senior angular developer

Code.Hub

middleware java engineer new

Code.Hub

junior data scientist

XM

data engineer

XM

senior php web developers

XM

data governance officer – team lead

XM

application support engineer new

Code.Hub

ai engineer – langchain & llm frameworks specialist

Code.Hub

ai engineer (llm quality analyst)

Code.Hub

backend technical leader (java chapter)

Code.Hub

Jobily.gr

For Employers

For Job Seekers

Company