software engineer — frontier ai systems (data & evals) (test mode)

توضیحات آگهی

Level Mid Level Location Yerevan Type Full Time The Context The bottleneck in Artificial Intelligence is no longer raw compute it is high signal domain specific complex data We are a boutique engineering consultancy and data lab We help the world s leading model providers go from 0 1 on their most difficult post training challenges We don t scrape the open web we build the gyms that frontier models work out in Think complex execution environments terminal based benchmarks like Terminal Bench or OSWorld programmatic synthetic data pipelines and bespoke evaluation harnesses We are assembling our core delivery engineering team We do not need you to know how to pre train a 70B parameter model from scratch We do need you to be one of the fastest learners in the room The Reality of this Role Read This First In a standard mid level engineering role a product manager hands you a scoped ticket a designer gives you a Figma file and you write the code This is not that job Next Monday a client might ask us to build an evaluation harness for an AI agent trying to resolve messy git merge conflicts in a headless Linux environment The Monday after that we might be designing a synthetic data generator that tests multi turn math reasoning There are no StackOverflow threads for the edge cases you will hit There is no textbook If your natural instinct when hitting a technical wall is to sit back flag it as blocked and wait for a Senior Engineer to spoon feed you the architecture you will hate working here If your natural instinct is to open the arXiv paper test three hacky workarounds by 4 00 PM look at the raw stdout logs and figure out the ground truth yourself you will thrive here What You Will Actually Do Build the Gyms Design and deploy programmatic evaluation environments sandboxed OS environments Dockerized test beds API mockers that test whether an AI model can actually do complex tasks Engineer Synthetic Pipelines Write the orchestration logic to generate filter mutate and deterministically verify high quality synthetic datasets at scale Build Human in the Loop HITL Tooling Create the internal workflows and custom annotation interfaces that allow domain experts to label complex data 10x faster Translate Research to Engineering Take a high level ambiguous request from an AI Lab We need a dataset that exposes where our model fails at spatial reasoning and turn it into a concrete executable software pipeline What We Are Looking For The Foundation You ve shipped complex production systems We don t care what your favorite programming language is syntax is a solved problem We care about your mental model of how computers work because you will be directing AI agents to do the typing for you Extreme Mental Elasticity You can get dropped into a messy half documented open source repository understand its core execution loop in an hour and bend it to do what we need High Agency You take a goal map the intermediate steps yourself and drive it to completion You don t manage tasks you manage outcomes Systems Pragmatism You understand async pipelines concurrency basic containerization Docker and how to talk to LLM endpoints without blowing up rate limits or budget constraints Zero Dogma You care about whether the data output is strictly correct not whether the script that generated it used the trendy framework of the month Very Strong Pluses Nice to have but we will teach you Prior experience working directly with LLM pipelines LangChain LlamaIndex DSPy or raw OpenAI Anthropic API orchestration loops A conceptual grasp of the modern post training stack SFT RLHF DPO and why synthetic data collapses happen Experience using contributing to or trying to beat open source agentic benchmarks SWE bench OSWorld GAIA etc A background in competitive programming complex systems debugging or obsessive side projects Do Not Apply If You measure your productivity by tickets closed rather than problems solved You view researching how a system works as a distraction from your job rather than the core of it You need a stable highly predictable 6 month product roadmap to feel comfortable What We Provide The Greenhouse We are a 0 1 company We cannot offer you a bloated Big Tech base salary or a corporate wellness stipend Instead we offer you a high velocity launchpad The Career Fast Forward Working here for 24 months will compress 6 years of standard industry learning into your brain You will be operating at the exact bottleneck of the AI revolution When you leave this house you will not be a Junior Dev you will be qualified to walk into any Tier 1 Frontier Lab in the world as a Data Systems Engineer Armenian Work Sponsorship Full visa and legal relocation sponsorship to Yerevan Armenia one of the fastest growing safest and most vibrant emerging tech hubs in Eurasia The Hacker House Your housing is solved You will live in our live in Hacker House in Yerevan You won t be working in an isolated bedroom you will wake up grab coffee and whiteboard synthetic data failures at midnight with a house full of obsessed high agency peers Zero Cognitive Load Compensation Because your rent and utilities are covered by the house we provide a base salary strictly calibrated to give you a comfortable frictionless life in Yerevan great food going out gym weekend trips 100 of your brainpower goes to work 0 goes to survival math Real Skin in the Game Generous early stage equity We are a boutique lab building high value IP if we turn this into a major data provider your personal upside moves with the company not a standard corporate banding chart Named Exposure to the Giants Because we work directly with model providers your work doesn t disappear into an internal repo You will get direct visibility into the post training engineering teams at the top AI labs in the world Submit Your CV https araxitis com careers software engineer frontier ai systems data evals source jobvision خارج کشور تمام وقت آراکسیتیس کارشناس جنسیت تفاوتی ندارد فناوری اطلاعات نرم افزار و سخت افزار