Software Engineer III
— · Baltimore, US
Job description
Job Description
SALARY RANGE $209,000 - $266,000/year
DUTIES As a successful candidate for the Senior Software Engineer role, you should have a strong background in building scalable AI-powered applications and the infrastructure that supports them, with a focus on delivering exceptional user experiences. You will play a crucial role in architecting and developing the systems that power our cutting-edge LLM applications, ensuring they perform reliably at enterprise scale while enabling rapid iteration and deployment.
,
Required Skills
SKILLS
Lead the design and development of scalable LLM-powered applications and services
Architect infrastructure solutions that support rapid iteration and deployment of AI features
Collaborate directly with product teams to translate user needs into technical solutions
Build and maintain the platforms that enable your team to ship AI features quickly and reliably
Develop and manage automation tools to improve system reliability and development efficiency
Implement and maintain monitoring, alerting, and logging systems
Conduct capacity planning and performance tuning for AI workloads
Lead and participate in incident response and post-mortem analyses
Mentor junior team members and contribute to the overall growth of the engineering team
Continuously identify and implement improvements to our systems and development processes
QUALIFICATIONS Twelve (12) years' experience as a SWE in programs and contracts of similar scope, type, and complexity is required. A Bachelor's degree in Computer Science or a related discipline from an accredited college or university is required. Four (4) years of additional SWE experience on projects with similar software processes may be substituted for a bachelor's degree.
Additional requirements:
12+ years of experience in software engineering with focus on scalable systems
Strong full-stack development experience with user-facing applications
Strong programming skills in languages such as Python, Go, or Java
Extensive experience with cloud platforms (e.g., AWS, GCP, Azure) and their services
Proficiency in containerization technologies (Docker, Kubernetes)
Experience with infrastructure-as-code tools (e.g., Terraform, Ansible, Puppet)
Expertise in monitoring and observability tools (e.g., Prometheus, Grafana, ELK stack)
Familiarity with CI/CD pipelines and practices
Strong problem-solving skills and ability to troubleshoot complex systems
Excellent communication skills and ability to work in a collaborative environment
Experience building products that prioritize user experience and product-market fit
Experience interacting with stakeholders to elicit requirements
,
Desired Skills
NICE-TO-HAVES
Experience working with Large Language Models (LLMs) and related infrastructure
Experience with AI/ML model serving and optimization
Background in product-focused engineering environments
Familiarity with machine learning operations (MLOps) practices
Experience with A/B testing and feature flagging for AI features
Contributions to open-source projects
Experience with distributed systems and microservices architectures
Knowledge of security best practices and compliance requirements
Experience with real-time data processing and streaming platforms (e.g., Apache Kafka, Apache Flink)
Familiarity with chaos engineering principles and tools
,
About Black Eagle Defense
Black Eagle Defense is a Maryland-based small business that provides Information Technology, Cybersecurity, and related Consulting Services to the private and public sectors. Our team is composed of highly trained professionals with a commitment to continued learning, versatility, and adaptability within the ever-evolving technological landscape.
We are proud to be an Equal Employment Opportunity and Affirmative Action employer.
ML/AI Work links you to the employer's original posting — always verify the details there before applying.
More MLOps and Platform roles
View all →Machine Learning Engineer, Generative ML , Level 5
Snap Inc. · Anaheim, US
Director, AI Engineering
Menarini · Remote · New York
Senior Platform Engineer - AI
Datavant · Remote · New York
Director - AI Platform Engineering
eBay · Remote · San Jose
Senior Data Scientist (TS/SCI with CI Poly Required)
DeNovo Solutions · Aurora, US
Project Lead AI
Entico · Charleroi, BE