Explore 1M+ Live Opportunities.
Direct applications, high-package MNC listings, and exclusive insider referrals updated daily across 50+ niches worldwide.
Direct applications, high-package MNC listings, and exclusive insider referrals updated daily across 50+ niches worldwide.
Data Capital Incorporation · McLean, Virginia
Data Capital Inc. is seeking a
Senior LLM Cost Optimization Engineer
with proven experience reducing enterprise Generative AI infrastructure and inference costs while maintaining application quality and performance.
We need a hands-on AI cost optimization specialist—not a traditional cloud FinOps analyst or reporting-only professional.
Key
Analyze and optimize enterprise LLM API usage, token consumption, and inference costs.
Implement intelligent model routing, prompt caching, semantic caching, and token optimization.
Develop AI cost monitoring dashboards, usage analytics, budget controls, and chargeback/showback.
Optimize AWS Bedrock and other enterprise LLM platforms for cost efficiency.
Evaluate API-based vs. self-hosted LLM deployment costs and infrastructure utilization.
Optimize enterprise AI licensing and eliminate unnecessary AI platform spending.
7+ years
in software, cloud/platform engineering, or FinOps, including
2+ years working with LLM platforms .
Hands-on experience optimizing LLM token usage, model selection, caching, and inference costs.
Experience with LiteLLM, Langfuse, LangSmith, Helicone, or similar LLM observability/gateway tools.
Strong AWS experience, including Bedrock, Cost Explorer, and cloud cost management.
Experience building cost dashboards using Grafana, Power BI, QuickSight, or equivalent.
Must demonstrate measurable production LLM cost savings without compromising quality or performance.
Preferred:
AI FinOps, provisioned throughput optimization, GPU infrastructure cost analysis, financial services experience.
Screening Requirement:
Applicants must provide one real-world LLM cost optimization project, including the cost reduction achieved, technologies used, and how quality was maintained.
Details
| Company | Data Capital Incorporation |
| Location | McLean, Virginia |
| Type | FULL TIME |
| Niche | Full-time |