Senior Data Engineer (GenAI / LLM)
Diverse Consulting Group · Warsaw, PL
Job description
As a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for:
Senior Data Engineer (GenAI / LLM)
Responsibilities:
- Design and implement LLM‑ and agent‑assisted workflows to improve developer productivity and reliability of data pipeline delivery
- Build and enhance AI‑driven automation for engineering processes, including: pull request automation, quality gates and assistive development tooling
- Implement AI‑supported schema review and governance gates within the canonical message lifecycle
- Drive AI‑powered test automation, including automated E2E test generation and quality validation
- Develop and maintain data packaging pipelines transforming source data into canonical message formats aligned with Data Packaging Framework and Availability Layer patterns
- Build and manage SQL‑based data transformations and configuration‑driven pipelines
- Support the canonical message lifecycle, including:schema validation, versioning, compatibility checks and publishing workflows
- Contribute to framework releases, operational stability, and documentation
- Maintain and update Architecture Decision Records (ADRs)
Requirements:
- Hands-on experience building LLM-powered automation for engineering workflows (e.g., review gates, quality checks, assistant tooling for dev/test/docs)
- Experience with AI-assisted review/approval flows and integrating AI steps into CI/CD-style pipelines
- Experience with AI-assisted test generation / test automation concepts
- Strong engineering discipline around quality and safety for AI outputs (evaluation mindset, reproducibility, traceability)
- Strong experience in data engineering and distributed processing; practical delivery mindset
- Hands-on experience with Kafka and SQL-based transformations
- Experience with batch/stream processing frameworks (e.g., Flink or Spark)
- Familiarity with schema formats and lifecycle (e.g., JSON/Avro/XSD) and versioning/compatibility concepts
- Experience working with Git workflows and Kubernetes environments
- CI/CD and build pipeline experience (Bazel + Tekton)
Nice to have:
- Experience with Data Reference Architecture / data product model
- Knowledge of Airflow, Snowflake, Iceberg, or similar data platforms
- Exposure to data governance, metadata, and lineage concepts
- Experience in banking or other regulated environments
Offer:
- Private medical care
- Co-financing for the sports card
- Constant support of dedicated consultant
- Employee referral program
ML/AI Work links you to the employer's original posting — always verify the details there before applying.
More Core AI Engineering roles
View all →AI Engineer
Visiotech España · Remote · Madrid
Remotetoday
Software R&D Engineer, RTL Optimization Tools
NVIDIA · Austin, US
$136,000 – $218,500/yrtoday
Staff AI Engineer
Acquia · Remote · Boston
$180,000 – $230,000/yrRemoteStafftoday
Senior Developer Relations Manager — Security and AI Software
NVIDIA · Oakland, US
$224,000 – $356,500/yrSeniortoday
AI Developer
Amana Living · Perth, AU
today
Senior Full-Stack Developer (AI/LLM)
NOUS SRL · Bari, IT
Seniortoday
Senior Data Engineer (GenAI / LLM)
Diverse Consulting Group