Systems Engineer, Infrastructure
New Yesterday
About HUDHUD (YC W25) is developing agentic evals for Computer Use Agents (CUAs) that browse the web. Our CUA Evals framework is the first comprehensive evaluation tool for CUAs.Our Mission: People don't actually know if AI agents are working. To make AI agents work in the real world, we need detailed evals for a huge range of tasks.We're backed by Y Combinator, and work closely with frontier AI labs to provide agent evaluation infrastructure at scale.About the roleWe're looking for a systems/full-stack engineer to help build out the technical infrastructure that enables comprehensive CUA testing at scale.ResponsibilitiesBuild out HUD's existing CUA evaluation frameworkOptimize our evaluation infrastructure at scaleExperienceTechnical SkillsExperience with AWS, Kubernetes, Docker, Redis, Linux, Python, PostgreSQLSystems design, performance security, CI/CD management experience preferredYou may be a good fit if you:Have hands-on experience with scalable infrastructure design and implementationHave contributed to large-scale system architecture projectsBuilt reliable, high-performance distributed systemsWorked with containerized applications and orchestration platformsStrong candidates may have:Startup experience in early-stage technology companies with ability to work independently in fast-paced environmentsStrong communication skills for remote collaboration across time zonesFamiliarity with current AI tools and LLM capabilitiesUnderstanding of LLM evaluation frameworks and methodologiesEvidence of rapid learning and adaptability in technical environmentsWe prioritize technical aptitude and learning potential over years of experience. Motivated candidates are encouraged to apply even if they don't meet all criteria.Team & Company DetailsTeam Size: ~5-10 people currently, looking to hire 2-3 additional people (though we judge case-by-case - could be zero or a lot more depending on candidates).Our team: Our team includes 4 international Olympiad medallists (IOI, ILO, IPhO), serial AI startup founders, and researchers with publications at ICLR, NeurIPS etc.LogisticsEmployment: Fulltime.Location: Remote-friendly, but if you’re in the SF Bay Area, we do have an office you can work together in. We do prefer applicants who can show up to meetings in Pacific Time (UTC-7:00/8:00) or China/Singapore Time (UTC +8:00).Visa Sponsorship: We provide support for relocation and visas for strong full-time candidates.Timeline: Applications are rolling. The process should involve 1-2 interviews and take less than a week.Due to high volume, we may not actively respond to every application, but feel free to contact us at recruiting@hud.so or elsewhere if we missed your application!
#J-18808-Ljbffr
- Location:
- San Francisco, CA, United States
- Job Type:
- FullTime