Annotation Operations Lead - Code
Cohere
Operations
London, UK
Posted on Wednesday, May 8, 2024
Who are we?
Our mission is to scale intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.
We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. We like to work hard and move fast to do what’s best for our customers.
Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft. Each person is one of the best in the world at what they do. We believe that a diverse range of perspectives is a requirement for building great products.
Join us on our mission and shape the future!
Why this role?
The Annotation Operations Lead - Code is responsible for building and managing Cohere’s team of annotators who develop and deliver high-quality training data critical to the development of Cohere's code capabilities. You will join a small and effective team who orchestrate Cohere’s human data collection efforts.
Your day-to-day will include helping stakeholders translate their data needs into annotation projects, running daily stand ups and being the on-the-ground support for the annotators, reviewing data, and iterating on projects and processes to improve the way we run this program.
As an Operations Lead you will:
- Scale the code teams annotation output while improving quality and effectiveness of their work
- Partner with internal stakeholders to decide on staffing and hiring strategy to meet roadmap requirements, as well as work with external vendors to enrich our data pipeline as needed
- Test-iterate regularly by running pilots and experiments, and stay up-to-date on industry trends and best practices
- Own individual and team-wide performance management of our code generation annotators, including partnering with the Data Ops team to continuously improve our performance management KPIs, plans, and processes
- Run and develop onboarding for new code generation annotators, as well as identifying opportunities and tools for ongoing education to up-skill, coach, and improve the team
You might be a good fit if you:
- Have 2+ years experience in a hands-on coding role
- Are proficient in Python, one of C++/Java/Compiled language, and SQL
- Have experience leading a nimble team or a complex project group with great results in a tech-focused role
- Thrive off collaboration with a multifaceted cross-functional team
- Have strong writing and editing skills
- Have the grit to navigate a fast paced startup environment with changing priorities
- Enjoy coaching teammates and solving complex problems
- Preferred: London-based candidates, who are ready to spend a few days a week in our Soho office with our Annotator team
If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply! If you consider yourself a thoughtful worker, a lifelong learner, and a kind and playful team member, Cohere is the place for you.
We value and celebrate diversity and strive to create an inclusive work environment for all. We welcome applicants of all kinds and are committed to providing an equal opportunity process. Cohere provides accessibility accommodations during the recruitment process. Should you require any accommodation, please let us know and we will work with you to meet your needs.
Our Perks:
🤝 An open and inclusive culture and work environment
🧑💻 Work closely with a team on the cutting edge of AI research
🍽 Weekly lunch stipend, in-office lunches & snacks
🦷 Full health and dental benefits, including a separate budget to take care of your mental health
🐣 100% Parental Leave top-up for 6 months for employees based in Canada, the US, and the UK
🎨 Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
🏙 Remote-flexible, offices in Toronto, New York, San Francisco and London and co-working stipend
✈️ 6 weeks of vacation
Note: This post is co-authored by both Cohere humans and Cohere technology.