Data Science PySpark & Generative AI Engineer

About the role

We are seeking a Data Science Engineer with strong expertise in PySpark and Generative AI to join a cutting‑edge technology team serving the financial services sector. The role is fully remote and focuses on building scalable AI‑driven solutions that support strategic digital transformation initiatives.

Key responsibilities

• Design and develop advanced Generative AI applications using large language models, intelligent agents and modern AI architectures.
• Build, optimize and maintain large‑scale data processing pipelines with Python, PySpark and Apache Spark.
• Integrate AI capabilities into distributed data environments while ensuring performance, reliability and maintainability.
• Collaborate with cross‑functional, international teams in an agile setting to deliver innovative solutions.
• Participate in architectural discussions and contribute to the evolution of data and AI platforms.
• Implement monitoring, observability and evaluation frameworks for AI components, including RAG‑based solutions and guardrails.

Required profile

• Strong professional experience in Python and/or PySpark within data engineering, data science or AI projects.
• Hands‑on expertise with Apache Spark and distributed processing environments.
• Proven track record designing and deploying Generative AI solutions (AI agents, RAG, LLM‑based applications).
• Ability to develop scalable, high‑performance solutions for enterprise‑grade settings.

Required skills

• Python
• PySpark
• Apache Spark
• Generative AI frameworks
• Large Language Models (LLM)
• AI agents and RAG architectures
• AI evaluation, monitoring and observability
• Orchestration tools for AI workflows