Databricks Developer

Must Have Technical/Functional Skills

• Design and develop scalable data pipelines and ETL workflows using Databricks (Spark, PySpark)

• Build and optimize Delta Lake architectures for high-performance data processing

• Develop and deploy AI/ML models and advanced analytics solutions

• Implement Agentic AI / GenAI solutions using Databricks (e.g., Agent Bricks, LLM-based workflows)

• Develop BI and analytics datasets for downstream reporting and visualization

• Collaborate with business and data science teams to translate requirements into solutions

• Optimize performance, cost, and scalability of data pipelines on cloud platforms

• Ensure data quality, governance, and compliance standards are met

• Excellent problem-solving and communication skills.

Roles & Responsibilities

We are seeking an experienced Databricks Developer to design, develop, and optimize scalable data and AI-driven solutions on cloud platforms. The role requires strong expertise in data engineering, machine learning, and modern analytics leveraging Databricks and AI frameworks.

Key Responsibilities

• Design and develop scalable data pipelines and ETL workflows using Databricks (Spark, PySpark)

• Build and optimize Delta Lake architectures for high-performance data processing

• Develop and deploy AI/ML models and advanced analytics solutions

• Implement Agentic AI / GenAI solutions using Databricks (e.g., Agent Bricks, LLM-based workflows)

• Develop BI and analytics datasets for downstream reporting and visualization

• Collaborate with business and data science teams to translate requirements into solutions

• Optimize performance, cost, and scalability of data pipelines on cloud platforms

• Ensure data quality, governance, and compliance standards are met

Required Skills & Experience

• Strong hands-on experience with Databricks (Workflows, Delta Lake, Unity Catalog)

• Expertise in ETL/Data Engineering using Spark/PySpark

• Experience with AI/ML model development and deployment

• Knowledge of Agentic AI / GenAI frameworks and LLM integration

• Strong understanding of cloud platforms (AWS / Azure / GCP)

• Experience with BI tools (Power BI, Tableau, etc.)

• Proficiency in SQL, Python

Salary Range: $100,000 to $140,000 per year

Location

Raleigh, NC

Job Function

TECHNOLOGY

Role

Engineer

Job Id

417649

Desired Skills

Spark

Salary Range

$100,000-$140,000 a year

Desired Candidate Profile

Qualifications : BACHELOR OF COMPUTER SCIENCE