Sr. AI Engineer

Job ID: 1150950_RR00111072

Facility: NYU Grossman School of Medicine

Position Type: Full-Time/Regular

Shift: Day

Schedule: 9am-5pm

Department: IT/Health IT/Informatics, MCIT-Future Practice (S2129), NYU Grossman School of Medicine,

NYU Grossman School of Medicine is one of the nation’s top-ranked medical schools. For 175 years, NYU Grossman School of Medicine has trained thousands of physicians and scientists who have helped to shape the course of medical history and enrich the lives of countless people. An integral part of NYU Langone Health (Opens in a new window), the Grossman School of Medicine at its core is committed to improving the human condition through medical education, scientific research, and direct patient care. At NYU Langone Health, equity and inclusion are fundamental values. We strive to be a place where our exceptionally talented faculty, staff, and students of all identities can thrive. We embrace inclusion and individual skills, ideas, and knowledge.

For more information, go to med.nyu.edu (Opens in a new window), and interact with us on LinkedIn (Opens in a new window), Glassdoor (Opens in a new window), Indeed (Opens in a new window), Facebook (Opens in a new window), Twitter (Opens in a new window) and Instagram (Opens in a new window).

Position Summary:

We have an exciting opportunity to join our team as a Sr. AI Engineer.

In this role, the successful AI Engineer will design, implement, and operate production-grade Generative AI and Machine Learning solutions that support NYU Langone Healths Remote Patient Monitoring (RPM) initiatives. You will work at the intersection of healthcare and technology to deploy, monitor, and optimize large language models and supporting services for real-time clinical workflows, patient engagement, and operational use cases. Partnering with data scientists, clinicians, care teams, and IT, you will bring practical, reliable, and compliant AI capabilities into the RPM platform and related systems.

Job Responsibilities:

• • Design and implement MLOps/LLMOps pipelines to deploy, monitor, and manage large language models in production healthcare environments, following software engineering best practices and team standards.

    • Collaborate with data scientists to deploy and/or fine-tune high-performing Generative AI models (e.g., for summarization, triage, patient messaging) and apply modern techniques from relevant published work where appropriate.

    • Develop scalable and robust data and ML pipelines for ingestion, preprocessing, validation, training, evaluation, and model deployment across the RPM ecosystem.

    • Implement monitoring and observability for AI applications, including tracking performance metrics, latency, model drift, safety indicators, and data quality; maintain model versioning and experiment tracking using tools such as MLflow or Kubeflow.

    • Evaluate and recommend AI tools and frameworks to meet clinical and operational requirements, including decisions around retrieval-augmented generation (RAG), vector databases, embedding models, and LLM providers, balancing compliance, performance, and cost.

    • Optimize inference performance and cost efficiency through techniques such as model quantization, batching, caching, and effective resource allocation; leverage containerization and orchestration tools (Docker, Kubernetes) for scalable, reproducible deployments.

    • Implement internal security and data protection standards in AI applications; ensure HIPAA compliance and adherence to institutional governance for PHI; assist with emerging AI risk, safety, and security controls.

    • Support the team in preparation for technical reviews and internal documentation (architecture, IT Security, AI), including design documents, runbooks, and operational procedures.

    • Collaborate with other team members and stakeholders to meet team objectives; partner with clinicians and product stakeholders to understand workflows, gather feature requirements, identify and document AI opportunities, create appropriate tickets, participate in backlog refinement, execute tickets, and engage in code-review activities.

    • Integrate CI/CD practices for AI applications to enable reliable, automated testing, deployment, and rollback in cloud environments.

    • Stay updated with the latest industry trends and advancements in Generative AI, LLMOps, and relevant cloud technologies; routinely share and demonstrate learnings with the team.

    • Provide technical guidance and coaching to less experienced team members; contribute to standards, reusable components, and best practices for AI development and operations.

    • Participate in all phases of the AI software development life cycle, including functional analysis, prototyping, development, evaluation, testing, deployment, refactoring, and technical support.

    • Performs other duties as assigned.

Minimum Qualifications:

To qualify you must have a 1. Bachelor’s degree in computer science, software engineering, or a related field.

2. At least 1-3 years of hands-on experience in AI Solution development

3. Strong programming skills in Python, or other languages commonly used in AI development.

4. Substantial knowledge of AI, machine learning, and deep learning

5. Experience with AI platforms like PyTorch or TensorFlow

6. Experience with building large-scale and/or compute-intensive applications on clusters for data engineering, model training and evaluation (HPC, Spark, Kubernetes)

7. Understanding of software development principles and methodologies, including data structures, data modeling and software architecture.

8. Excellent problem-solving skills and ability to work in a team environment.

9. Excellent communication skills, both verbal and written.

Preferred Qualifications:

• Masters degree in computer science, data science, biomedical informatics, software engineering, or a related quantitative discipline.
• 35 years of hands-on experience delivering production AI solutions, including LLM-based applications.
• Experience with at least one major cloud platform (Azure, AWS) and cloud-native AI/ML toolchains; familiarity with CI/CD practices for AI applications.
• Practical experience implementing retrieval-augmented generation (RAG), semantic search, and embedding models; knowledge of vector databases.
• Experience with MLOps/LLMOps tooling (e.g., MLflow, Kubeflow, Airflow, Weights & Biases) for experiment tracking, model versioning, and monitoring/observability.
• Experience building or maintaining AI-enabled healthcare applications, integrating with EHR systems, and operating within regulated environments (HIPAA); understanding of prompt engineering and fine-tuning methodologies; familiarity with LLM provider APIs (e.g., OpenAI, Anthropic, Azure OpenAI).

Qualified candidates must be able to effectively communicate with all levels of the organization.

NYU Grossman School of Medicine provides its staff with far more than just a place to work. Rather, we are an institution you can be proud of, an institution where you’ll feel good about devoting your time and your talents. At NYU Langone Health, we are committed to supporting our workforce and their loved ones with a comprehensive benefits and wellness package. Our offerings provide a robust support system for any stage of life, whether it’s developing your career, starting a family, or saving for retirement. The support employees receive goes beyond a standard benefit offering, where employees have access to financial security benefits, a generous time-off program and employee resources groups for peer support. Additionally, all employees have access to our holistic employee wellness program, which focuses on seven key areas of well-being: physical, mental, nutritional, sleep, social, financial, and preventive care. The benefits and wellness package is designed to allow you to focus on what truly matters. Join us and experience the extensive resources and services designed to enhance your overall quality of life for you and your family.

NYU Grossman School of Medicine is an equal opportunity employer and committed to inclusion in all aspects of recruiting and employment. All qualified individuals are encouraged to apply and will receive consideration. We require applications to be completed online.

View Know Your Rights: Workplace discrimination is illegal (Opens in a new window).

NYU Langone Health provides a salary range to comply with the New York state Law on Salary Transparency in Job Advertisements. The salary range for the role is $97,589.96 – $140,000.00 Annually. Actual salaries depend on a variety of factors, including experience, specialty, education, and hospital need. The salary range or contractual rate listed does not include bonuses/incentive, differential pay or other forms of compensation or benefits.

To view the Pay Transparency Notice, please click here (Opens in a new window)

Salaries shown on independent jobs related websites reflect market averages and do not represent information obtained directly from NYU Langone. We invite and encourage each candidate to discuss salary/hourly specifics during the application and hiring process.

About NYU Langone Health Be Where Everyone Is Dedicated to Exceptional Care

NYU Langone is a world-class, patient-centered, integrated academic health system with Magnet®-recognized status by the American Nurses Credentialing Center (ANCC). Our trifold mission to care, teach, and discover is achieved daily through NYU Langone’s inclusive culture devoted to excellence across the organization. Here, you can advance your career supported by exceptionally talented faculty and staff in an environment where everyone works together to deliver the best possible outcomes for our patients.

Our Hiring Process Joining Our Team

Get ready to start your career journey at NYU Langone, where cutting-edge research meets compassionate care, and discover how you can contribute to shaping the future of medicine.

Step 1

Apply Online

The NYU Langone hiring process begins with you applying through our online portal. Be sure to update and upload your resume. Shortly after you submit your application, you will receive an email confirmation. Ten days after applying you will receive a talent assessment to be completed.

Step 2

Schedule Interviews

If selected to continue the interview process, HR will reach out via phone or email first. Then, depending on your position, they will schedule an interview with unit managers or team members. You are encouraged to dress professionally for all interviews.

Step 3

Receive Offer

If you successfully complete the interview process and are identified as a finalist for the position, we will require that you complete a professional reference process. After evaluating the completed references, a decision will be made on who will receive a preliminary offer. If you receive a preliminary offer, HR will start the onboarding process with an agreed-upon tentative start date.

Step 4

Training & Orientation

You will be contacted by an onboarding specialist who will work with you on your pre-boarding requirements. Once fully cleared, we will ask you to complete compliance orientation regulatory training. On your first day, you will attend an online required orientation to acclimate to the health system and report to your new department based on instructions provided by your hiring manager.