AI Safety Specialist - Evaluation Expert
60 $ - 70 $ i timenMercor
København
- Fjernjob
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: AI Safety Practitioner
Type: Contract
Compensation: $60–$70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
- Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
- Apply and refine evaluation rubrics for RLHF , SFT , and AI safety benchmarking .
- Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
- Provide structured feedback to improve model alignment and safety performance.
- Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.
Qualifications
Must-Have
- Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.
- 5+ years of professional experience in AI Safety , Trust & Safety, journalism, public policy, scientific research, security, or a related field.
- Excellent written English , critical thinking, and analytical reasoning skills.
- Ability to consistently evaluate nuanced and policy-sensitive scenarios.
Preferred
- Experience with AI Safety , RLHF , SFT , Trust & Safety, or AI evaluation.
- Familiarity with safety policies, content moderation, or evaluation rubric development.
- Experience reviewing complex, high-risk, or ambiguous content.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Vis e-mail
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Ledig stilling opslået Indrykket for 2 dage siden
Tilsvarende jobs, som kan have interesseBaseret på AI Safety Specialist - Evaluation Expert vedrørende den ledige stilling i København
48 $ - 62 $ i timen
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: AI Safety Experts — English & Danish Type: Contract Compensation...Fjernjob48 $ - 52 $ i timen
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Bilingual Danish Generalist Expert — AI Safety Type: Contract Compensation... ...and safety, content moderation, policy evaluation, or adversarial testing. Start...Fjernjob70 $ - 84 $ i timen
...creative and technical talent with leading AI research labs. Headquartered in San... ..., and Jack Dorsey . Position: AI Safety Red Teamer Type: Contract... ...hallucinations, and policy failures. Evaluate model robustness across misinformation, cyber...Fjernjob90 $ i timen
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Preferred Prior RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel-perfect design-to-code...Fjernjob61 $ - 65 $ i timen
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Bilingual Danish STEM Expert (PhD) — AI Safety Type: Contract Compensation... ...specialized scientific topics. Evaluate and annotate model responses for...Fjernjob85 $ i timen
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...Fjernjob- ...experience with AEO ABOUT THE ROLE Search is being rebuilt by AI, and most agencies are pretending it isn't. We're not. We're restructuring... ...that didn’t exist 2 years ago, so we’re not expecting a deep expert. We’re looking for someone with some experience coming from SEM...
- ...Mercier Consultancy is currently offering an exciting opportunity for a Digital Trust and Safety Specialist with Danish and English based in Bulgaria . This role is ideal for Danish-speaking professionals who are passionate about online safety, digital security, and...
120 $ - 175 $ i timen
...technical talent with leading AI research labs. Headquartered in... ...Position: CAM Programming Expert (Fusion 360) Type: Contract... ...machinist standards. Evaluate existing CAM programs to determine... ...to assess real machine safety. ~ Written English fluency...Fjernjob- AI AGENT ENGINEER Department: AI Delivery Location: Copenhagen Working model: Onsite... ...include: * Automated testing and evaluation * Monitoring and regression detection... ...production feedback within defined quality and safety boundaries | "The principle is...
- ...our worldwide network of experts, clients and... ...risk analysis to process safety, forensic investigations... ...Conduct Risk Assessments: Evaluate industrial processes to... ...Certified Fire Protection Specialist (CFPS) or similar qualifications... ...intelligence (AI) tools like ChatGPT and...
- 3Shape is opening a new position in R&D for an experienced specialist who can help our organization make practical, everyday use of AI across engineering workflows. You will work closely with mechanical, electronics, and software teams to turn existing AI capabilities into...
800 € om året
...privacy compliance. About the Office of AI The Office of AI owns the strategy,... ..., RAG infrastructure, model operations, evaluation frameworks, and the engineering standards... ...speaker, or similar (e.g. Google Developer Expert). Former founder or CTO experience,...80 €
...reels daily, and is fascinated by the future of the Metaverse and AI? Ready to swap your daily routine for the sun-drenched, vibrant... ...policy and protect intellectual property rights. Digital Solutions Expert (Global Support): Help creators and businesses via chat and...- ...The Advisor Production team is building AI systems that automate accounting production... ...handling, structured LLM outputs, and an evaluation framework that ensures every change is... ...engineers, product managers, and accounting experts. You're curious but skeptical about...
13 $ i timen
...technical talent with leading AI research labs. Headquartered in... ...Annotation & Transcription Experts – Bengali Type: Contract... ...to end by a second Bengali expert, and experienced annotators... ...labeling, grading, or bilingual evaluation for training datasets. Transcription...Fjernjob- ...edge digital solutions. Our deep industry expertise spans Data & AI, software development, digital experiences, and business... ...transformation journeys. Senior MLOps Engineer / AI Platform Specialist Twoday is the leading digital transformation partner in Northern...
39 $ - 47 $ i timen
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...choice questions on Danish accounting, auditing, and tax for an AI evaluation dataset . Draft exam-style questions from professional...Fjernjob- ...an ambitious student looking to build a career at the overlap of AI and manufacturing? Are you excited about the latest developments... ...* Hands-on experience with MLOps/LLMOps practices, including evaluation frameworks, regression testing, monitoring, and observability. Experience...
39 $ - 47 $ i timen
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Draft original multiple-choice questions on Danish law for an AI evaluation dataset . Create exam-style questions with ten answer...Fjernjob- ...improve our working methods including how we adopt AI to work smarter. THE ROLE We are looking for a Technical Support Specialist to serve as the key bridge between our... ...configuration updates, and log analysis within defined safety, access, and change-control guardrails....
13 $ i timen
...technical talent with leading AI research labs. Headquartered in... ...Annotation & Transcription Experts – Odia Type: Contract... ...reviews of tasks by a second Odia expert . Qualifications... ...labeling, grading, or bilingual evaluation. Skills in transcription...Fjernjob13 $ i timen
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: PDF Annotation & Transcription Experts – Telugu Type: Contract... ...language AI data annotation or bilingual evaluation. Skills in transcription, localization...Fjernjob34 $ i timen
...technical talent with leading AI research labs. Headquartered in... ...Annotation & Transcription Experts – Korean Type: Contract... ...end-to-end by a second Korean expert. Qualifications Must... ..., grading, or bilingual evaluation. Skills in transcription...Fjernjob13 $ i timen
...technical talent with leading AI research labs. Headquartered in... ...Annotation & Transcription Experts – Gujarati Type: Contract... ...to end by a second Gujarati expert . Qualifications... ...annotation, labeling, or bilingual evaluation. Skills in transcription...Fjernjob34 $ i timen
...technical talent with leading AI research labs. Headquartered in... ...Annotation & Transcription Experts – Japanese Type: Contract... ...-to-end by a second Japanese expert. Qualifications Must... ..., labeling, or bilingual evaluation. Skills in transcription...Fjernjob800 € om året
...while achieving full privacy compliance. About the Office of AI The Office of AI owns the strategy, governance, infrastructure... ...an LLM access gateway, RAG infrastructure, model operations and evaluation frameworks as current candidates. But AI moves faster than any...- ...koordinerer sikkerhedsaktiviteter og meget mere. Du vil specifikt tage dig af at udarbejde sikkerhedsanalyser og sikkerhedsbeviser (safety cases) under anvendelse sikkerhedsanalyse metoder som f.eks. HAZOP, FMEA, og FTA. Du bliver ansvarlig for: Koordinering af...
- ...always been scarce: held by specialists, earned over years,... ...that ends that scarcity. AI can now take what lived only in a specialist's head and make it run:... ...that codify how the best experts handle an entire case type... ...they can act on, and an expert's judgment reaches a...
- ...luxury brands, is looking for mission-based Customer Experience Evaluators who are existing luxury brand customers. As a Freelance... ...service 70 countries. We are a team of 220+ customer experience experts and a network of over 80,000 evaluators worldwide. Learn more...
Vil du modtage flere ledige stillinger?
Abonnér og modtag tilsvarende ledige stillinger for AI Safety Specialist - Evaluation Expert. Bliv den første ansøger!
