Job Description

About North (

The public cloud is home to $200B+ in annual technology spend, yet 95% of it is still managed with credit cards and spreadsheets. With AI accelerating cloud growth towards $1T by 2030, businesses need better tools to manage, optimize, and scale their cloud investments.

At North, we’re building the next-generation cloud spend management platform, giving companies clarity, control, and automation over their cloud finances. Our mission is to help organizations take charge of their cloud costs and maximize efficiency in the AI-driven era.

Backed by top-tier investors and trusted by leading customers like Brave, StayNTouch, and DataBiologics, we’re assembling a world-class team to redefine how businesses manage cloud spend. If you’re looking for impact, growth, and the opportunity to shape the future of cloud finance, North is the place to be.

About the role

We’re looking for a Machine Learning Engineer to join our team and play a key role in developing, deploying, and optimizing our AI capabilities. You’ll work directly with our CTO to define and build AI-powered features that will shape Agent North, our customer-facing AI assistant, as well as drive advancements in cost and usage forecasting, financial modeling, and multi-service provider rightsizing.

This is a hands-on, senior-level role—perfect for someone who thrives in a fast-moving startup environment, has built ML-powered products before, and is comfortable taking a project from 0 to 1. If you’re a high-energy, motivated engineer passionate about LLMs, cloud infrastructure, and deploying AI systems at scale, we want to hear from you.

What you’ll do

• Design, build, and deploy ML models for cloud automation and optimization
• Work with LLMs, fine-tuning, optimizing, and integrating them into our platform
• Develop AI chatbots and customer-facing AI solutions to automate and enhance cloud finance management.
• Ensure security and compliance in AI model deployment, implementing best practices for secure AI infrastructure.
• Set up and maintain ML infrastructure across GCP, AWS, and Azure, optimizing for scale and efficiency.
• Drive ML project development from 0 to 1, making key decisions on architecture, tooling, and implementation.
• Collaborate with engineering, product, and leadership teams to align AI development with business goals.
• Experiment with and implement cutting-edge ML techniques, including prompt engineering, model security, continuous evaluation, and monitoring frameworks.
• Provide thought leadership, driving AI strategy and identifying opportunities to improve and expand North’s AI capabilities.

What you’ll need

• 5+ years of hands-on experience in ML, AI model development, and infrastructure deployment.
• Experience with Terraform and Git for infrastructure management and version control.
• Strong Python skills (bonus if you’re comfortable with Go, SQL).
• Proficiency with ML frameworks like PyTorch, Hugging Face, LangChain, vertex databases, and open source models like Llama.
• Experience deploying ML models at scale (cloud-based, distributed systems, or edge deployments).
• Security-first mindset—deep understanding of AI security risks and best practices.
• Ability to move fast and iterate, taking ideas from concept to production.
• Excellent communication skills, with the ability to clearly convey progress, methodology, solution approach, and results.
• Strong analytical background, capable of sifting through complex cost patterns and making sense of intricate financial cloud modeling.
• A proactive, solution-oriented mindset—you’re not just an executor, but a thought leader who can challenge assumptions and improve the product.

Nice to haves

• Experience working in a startup
• Built and deployed ML products or features in a production environment
• Hands-on implementation experience—we need builders, not just strategists
• Experience working with financial cloud data across GCP, AWS, and Azure
• Past experience in a cloud financial project or role
• AWS technical certification (or equivalent cloud certification)
• Experience deploying models in Amazon Bedrock or on AWS

Work location

This is a hybrid role in our New York office (in West Village). You will work part of the time in the office and part of the time remote / work-from-home. 

Benefits (for U.S.-based full-time employees)

• Unlimited PTO.
• NYC office access—work in West Village as desired.
• 16-week fully paid parental leave (mothers can extend to 20 weeks at 50% pay).
• Mandatory company-wide breaks: last week of August & Dec 23–Jan 3.
• Healthcare: Anthem BlueCross Gold PPO, 75% employer-covered. 
• 30-day sabbatical every 4 years.
• Ramp credit card for approved expenses.

Compensation

The base pay for this role is: $160k-$220k per year. Actual compensation may vary and will be based on a candidate's qualifications, skills, experience, and location.

Join us!

If you’re a ML engineer who loves building AI-powered products, deploying at scale, and shaping the future of cloud financial automation, we’d love to hear from you. Apply today.

Job Tags

Similar Jobs