AI Engineer (Remote in AU) at Budgetly

Melbourne, Victoria, Australia -

Full Time

Start Date

Immediate

Expiry Date

20 Sep, 26

Salary

170000.0

Posted On

22 Jun, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

TypeScript, React, Agentic Workflows, Systems Thinking, LLM Orchestration, Evaluation Harnesses, AWS Serverless, API Integration, Observability, Prompt Engineering, Software Architecture, Governance, Tool Calling, MCP Integration, CI/CD, Secure Execution

Industry

Software Development

Description

Company Description Managing business expenses shouldn’t be a guessing game. Yet many SMEs still lack clear cash flow visibility and spend control. At Budgetly, we’re changing that. We’re building an AI-first platform that simplifies expense management and helps businesses make better financial decisions, faster. The goal is simple: help you spend smarter, save time, and grow profitably. Why this role exists (and why it’s different) Six months ago, “agentic engineering” felt novel. Today, it’s rapidly becoming the default way teams ship software. Most companies are using AI to make engineers type faster. We’re building something more ambitious: We’re building an AI-first delivery system where agents ship product features end-to-end — and engineers build the platform (the harness) that makes it safe, reliable, and scalable. If this works, feature delivery scales with product ambition, not headcount. What we mean by “harness engineering” A raw LLM isn’t an agent. The “agent” is the model plus the harness around it. In this role, you’ll build that harness: Agent runtimes & execution loops (plan → act → observe → reflect; retries; stop conditions) Agentic loops & feedback loops that convert outcomes into improvements (evals, regressions, learnings) Tooling & skills (MCP/tool integration, internal APIs, secure credentials, sandboxes) Governance (permissions, policy, human-in-the-loop gates, audit trails) Observability (traces, cost attribution, failure taxonomies, runbooks) Evaluation harnesses (scenario suites, trajectory scoring, tool-arg correctness, “non-deterministic unit tests”) What success looks like in ~12 months A managed agent platform that product can rely on for meaningful, customer-facing delivery Agent workflows ship features with high repeatability, not “poke-and-hope” Clear quality gates: eval harnesses, review agents, regression suites, and rollout controls Engineers spend less time in the loop and on reviews and more on improving the factory (reliability, speed, safety) Job Description This isn’t a traditional senior engineering role. You won’t spend most of your time implementing product features directly. Your time will roughly split: 50% building and evolving agent harnesses: orchestration, toolchains, approvals, secure execution, managed agents 50% reviewing and improving outputs: tracing failures, improving prompts/steering, tightening eval harnesses, reducing loop count Concretely, you’ll: Design and implement agentic workflows that take a requirement from spec → code → review → deploy Build agentic loops that turn mistakes into system-level improvements (not one-off fixes) Develop evaluation harnesses (offline + CI) to detect regressions in behavior, not just tests in code Define and maintain review gates (human-in-the-loop + automated reviewers) for risky changes Improve tool reliability: schemas, typed tool interfaces, retries, timeouts, safety checks Build platform capabilities for managed agents: long-running sessions, checkpoints, state/memory boundaries, and recovery Evolve the platform architecture (TypeScript, serverless architecture, shared codebase) with an eye for simplicity and maintainability Partner with Product to reduce ambiguity and translate intent into testable, evaluable specs Qualifications This role requires strength in two areas, equally: Systems thinking for agent harnesses and loops. You can design the execution harness around agents: feedback loops, evaluation strategy, safety constraints, and the “glue code” that makes autonomy safe in production. Engineering taste. You can look at agent-generated code and immediately judge: conventions, simplicity, correctness, maintainability, security. Not just “does it work,” but “would I approve this PR in a regulated product?” What we need from you Strong TypeScript and React experience in production environments You’ve shipped real software to real users (not just prototypes) You can read a codebase and quickly identify its patterns, conventions, and architecture You are comfortable working in ambiguity and turning fuzzy intent into clear acceptance criteria + evals Familiarity with agent tooling concepts: tool calling, MCP/tool integration, guardrails, evals, tracing/observability, and permissioning Nice to have: AWS serverless experience (CDK, Lambda, DynamoDB). Our backend is a mix of modern serverless microservices and a legacy Express/PostgreSQL monolith. Who this role is not for Be honest with yourself: If you want to spend most of your time building features directly, this role will frustrate you If you’re excited about AI but haven’t shipped production software, you won’t have the taste to judge agent output If you prefer stable scope, established best practices, and minimal ambiguity, this environment won’t be a match The team and company You’ll join a small team (3–4 engineers) reporting to a hands-on CTO. The company is going all-in on this model, not just engineering - sales, marketing, and support are all building agentic workflows for their functions. This isn’t a side experiment; it’s our operating model. Additional Information We’re guided by trust, respect, and ownership. Our values — Embrace Change, Carte Blanche, Find Wisdom in Data, and We All “Own It” — shape how we work. Fully remote (work from anywhere in Australia) 5 weeks annual leave and flexible working Monthly Wellness Budget (mental & physical health) Employee share options (ESOP) for all team members How to apply? Submit your CV via the application form. Note that background checks are required as part of our offer process. We welcome applications from all backgrounds, abilities, and identities. We value diversity and believe it enhances creativity, innovation, and overall success. Compensation: AUD 140000 - AUD 170000 - yearly

How To Apply:

Incase you would like to apply to this job directly from the source, please click here

Responsibilities

Design and implement agentic harnesses, runtimes, and execution loops to enable AI agents to ship product features end-to-end. Focus on building evaluation frameworks, review gates, and platform capabilities to ensure the reliability and safety of AI-generated code.