Sr Applied Scientist, Support Agent Intelligence and Evaluation

$167K - $226K Seattle, WA, US Senior Research Scientist

Interested in this Research Scientist role at Amazon.com?

Apply Now →

Skills & Technologies

PythonTensorflow

About This Role

AI job market dashboard showing open roles by category

DESCRIPTION

---------------

Amazon Advertising is one of Amazon's fastest growing and most profitable businesses. Amazon's advertising portfolio helps merchants, retail vendors, and brand owners succeed via native advertising, which grows incremental sales of their products sold through Amazon. The primary goals are to help shoppers discover new products they love, be the most efficient way for advertisers to meet their business objectives, and build a sustainable business that continuously innovates on behalf of customers.

Millions of advertisers rely on Amazon's self\-service support experience to resolve issues, unblock campaigns, and grow their business. Our Support Agents team is building the science behind intelligent, conversational support — systems that understand advertiser intent, retrieve the right knowledge, generate accurate answers, and know when to escalate. We serve \~2M monthly active advertisers across dozens of locales and languages, and every percentage point of improvement in resolution quality translates directly into advertiser success and retention.

We are seeking an Applied Scientist who is passionate about building evaluation science, NLP systems, and quality measurement at scale. You will define how we measure "good" — designing LLM\-as\-a\-judge evaluation pipelines, developing our next\-generation Issue Resolution Rate (IRR) metrics, and closing the quality gap between English and non\-English markets. Your work will directly shape what ships to advertisers and what leadership uses to assess the health of our support experience.

Key job responsibilities

1\. Enhance support agent capabilities across the broad suite of Amazon Advertising products — expanding coverage, depth of resolution, and advertiser task completion across Sponsored Products, Sponsored Brands, DSP, AMC, and more

2\. Design and own the evaluation framework for agent quality — including automated LLM\-based scoring of answer correctness, confidence calibration, and conversation\-level resolution signals

3\. Develop novel metrics that capture whether advertisers actually got the help they needed (beyond surface\-level deflection rates)

4\. Build and improve retrieval and generation models that power real\-time advertiser interactions under strict latency SLAs

5\. Drive multilingual science — improve non\-English resolution rates through cross\-lingual retrieval, translation quality modeling, and locale\-aware evaluation

6\. Partner with product, engineering, and business teams to productize research and inform roadmap decisions with data

A day in the life

You might start the morning reviewing overnight evaluation results from your LLM\-as\-a\-judge pipeline, then jump into a whiteboard session designing a new resolution metric that captures whether advertisers actually unblocked their campaign. After lunch you're running offline experiments on a cross\-lingual retrieval model to close the quality gap for non\-English markets, and by end of day you're syncing with engineering on latency trade\-offs for next week's A/B test. The constant: your science directly changes the experience millions of advertisers have when they need help.

About the team

This role sits within Amazon Advertising's broader Agentic Intelligence organization — a community of multiple Applied Science and Engineering teams building the next generation of AI\-powered experiences for advertisers. You'll have access to Principal Engineers and Principal Applied Scientists to pressure\-test ideas and elevate your work.

What makes this team unique is the balance: you'll drive product\-facing science through customer support agents that touch millions of advertisers, while also influencing and collaborating with a core AI infrastructure team within Amazon. The team is cross\-functional — scientists and engineers work shoulder\-to\-shoulder, from problem framing through production deployment.

BASIC QUALIFICATIONS

------------------------

  • 3\+ years of building machine learning models for business application experience
  • PhD, or Master's degree and 6\+ years of applied research experience
  • Experience programming in Java, C\+\+, Python or related language
  • Experience with neural deep learning methods and machine learning

PREFERRED QUALIFICATIONS

----------------------------

  • Experience with modeling tools such as R, scikit\-learn, Spark MLLib, MxNet, Tensorflow, numpy, scipy etc.
  • Experience with large scale distributed systems such as Hadoop, Spark etc.
  • Experience in online or digital advertising

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how\-we\-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign\-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life \& AD\&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, WA, SEATTLE \- 167,100\.00 \- 226,100\.00 USD annually

Salary Context

This $167K-$226K range is above the median for Research Scientist roles in our dataset (median: $183K across 83 roles with salary data).

Role Details

Company Amazon.com
Title Sr Applied Scientist, Support Agent Intelligence and Evaluation
Location Seattle, WA, US
Category Research Scientist
Experience Senior
Salary $167K - $226K
Remote No

About This Role

Research Scientists push the boundaries of what AI can do. They design experiments, develop novel architectures, publish papers, and translate research breakthroughs into production capabilities. This is where the fundamental advances happen, from attention mechanisms to diffusion models to reasoning chains.

The work is intellectually demanding and often ambiguous. You might spend months on an approach that doesn't pan out. The best research scientists combine deep mathematical intuition with engineering pragmatism. They know when to go deep on theory and when to run experiments. They read papers voraciously and can spot incremental contributions from genuine breakthroughs.

Across the 3,708 AI roles we're tracking, Research Scientist positions make up 3% of the market. At Amazon.com, this role fits into their broader AI and engineering organization.

Research Scientist roles are concentrated at major AI labs (OpenAI, Anthropic, Google DeepMind, Meta FAIR) and well-funded AI startups. The competition is intense. PhD is effectively required for most positions, and publication track record matters. Compensation is among the highest in AI, reflecting both the scarcity of talent and the strategic importance of research breakthroughs.

What the Work Looks Like

A typical week includes: reading and discussing recent papers with your team, designing and running experiments on multi-GPU clusters, analyzing results and iterating on hypotheses, writing up findings for internal review or publication, and collaborating with engineering teams to productionize promising results. The ratio of thinking to coding is higher than in engineering roles.

Research Scientist roles are concentrated at major AI labs (OpenAI, Anthropic, Google DeepMind, Meta FAIR) and well-funded AI startups. The competition is intense. PhD is effectively required for most positions, and publication track record matters. Compensation is among the highest in AI, reflecting both the scarcity of talent and the strategic importance of research breakthroughs.

Skills Required

Python (51% of roles) Tensorflow (11% of roles)

PhD strongly preferred for most roles. Deep expertise in a specific area (NLP, computer vision, reinforcement learning, multimodal) is expected. PyTorch is the standard. Publication track record matters. Strong mathematical foundations in linear algebra, probability, optimization, and information theory are assumed.

Beyond the fundamentals, companies value experience with large-scale distributed training, novel architecture design, and the ability to bridge theory and practice. Understanding of current frontier topics (reasoning, multimodal, long-context, alignment) is essential. Code quality matters more than many researchers expect. Labs want researchers who can implement their ideas cleanly.

Strong research postings specify the research area, mention the team you'd join, and describe the problems they're working on. They often list recent publications from the team. Vague 'AI research' postings without specifics usually mean the company wants to sound impressive but doesn't have a real research agenda.

Compensation Benchmarks

Research Scientist roles pay a median of $222,200 based on 197 positions with disclosed compensation. Senior-level AI roles across all categories have a median of $230,000. This role's midpoint ($196K) sits 12% below the category median. Disclosed range: $167K to $226K.

Across all AI roles, the market median is $217,500. Top-quartile compensation starts at $272,100. The 90th percentile reaches $325,000. For comparison, the highest-paying categories include AI Safety ($300,000) and Research Engineer ($280,000). By seniority level: Entry: $120,000; Mid: $200,000; Senior: $230,000; Director: $272,150; VP: $250,000.

Amazon.com AI Hiring

Amazon.com has 97 open AI roles right now. They're hiring across Research Scientist, AI/ML Engineer, Data Scientist, AI Product Manager. Positions span Sunnyvale, CA, US, Culver City, CA, US, San Francisco, CA, US. Compensation range: $97K - $327K.

Location Context

AI roles in Seattle pay a median of $236,900 across 267 tracked positions. That's 9% above the national median.

Career Path

Common paths into Research Scientist roles include PhD Student, Research Engineer, Postdoc.

From here, career progression typically leads toward Research Lead, Distinguished Scientist, VP of Research.

The PhD is the entry point for most paths. Choose your advisor and research area carefully since they'll define your first industry position. Publish consistently, contribute to open-source projects in your area, and build relationships at conferences. Industry research offers better compensation and compute resources than academia, but the pressure to show product impact is real.

What to Expect in Interviews

Research interviews are multi-stage: a research talk (present your best paper), technical deep-dives on your methodology, and often a 'research proposal' exercise where you design an experiment to test a hypothesis. Coding rounds test implementation ability alongside theoretical knowledge. Be prepared to implement a paper from scratch and discuss the design choices the authors made. Strong candidates can critique papers constructively and identify gaps in experimental methodology.

When evaluating opportunities: Strong research postings specify the research area, mention the team you'd join, and describe the problems they're working on. They often list recent publications from the team. Vague 'AI research' postings without specifics usually mean the company wants to sound impressive but doesn't have a real research agenda.

AI Hiring Overview

The AI job market has 3,708 open positions tracked in our dataset. By seniority: 102 entry-level, 1,705 mid-level, 1,469 senior, and 432 leadership roles (Director, VP, C-Level). Remote roles make up 14% of the market (508 positions). The remaining 3,180 roles require on-site or hybrid attendance.

The market median for AI roles is $217,500. Top-quartile compensation starts at $272,100. The 90th percentile reaches $325,000. Highest-paying categories: AI Safety ($300,000 median, 21 roles); Research Engineer ($280,000 median, 147 roles); AI Architect ($254,798 median, 67 roles).

Research Scientist roles are concentrated at major AI labs (OpenAI, Anthropic, Google DeepMind, Meta FAIR) and well-funded AI startups. The competition is intense. PhD is effectively required for most positions, and publication track record matters. Compensation is among the highest in AI, reflecting both the scarcity of talent and the strategic importance of research breakthroughs.

The AI Job Market Today

The AI job market spans 3,708 open positions across 16 role categories. The largest categories by volume: AI/ML Engineer (2,605), Data Scientist (310), AI Software Engineer (259). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.

The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (102) are outnumbered by mid-level (1,705) and senior (1,469) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 432 positions, representing the bottleneck between technical execution and organizational strategy.

Remote work availability sits at 14% of all AI roles (508 positions), with 3,180 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.

AI compensation is structured in clear tiers. The market median sits at $217,500. Top-quartile roles start at $272,100, and the 90th percentile reaches $325,000. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.

Category matters for compensation. AI Safety roles lead at $300,000 median, while Prompt Engineer roles sit at $140,000. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.

The most in-demand skills across all AI postings: Python (1,890 postings), Aws (1,103 postings), Azure (877 postings), Rag (855 postings), Gcp (631 postings), Prompt Engineering (560 postings), Pytorch (545 postings), Claude (498 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.

Frequently Asked Questions

Based on 197 roles with disclosed compensation, the median salary for Research Scientist positions is $222,200. Actual compensation varies by seniority, location, and company stage.
PhD strongly preferred for most roles. Deep expertise in a specific area (NLP, computer vision, reinforcement learning, multimodal) is expected. PyTorch is the standard. Publication track record matters. Strong mathematical foundations in linear algebra, probability, optimization, and information theory are assumed.
About 14% of the 3,708 AI roles we track offer remote work. Remote availability varies by company and seniority level, with senior and leadership roles more likely to offer location flexibility.
Amazon.com is among the companies actively hiring for AI and ML talent. Check our company profiles for detailed breakdowns of open roles, salary ranges, and hiring trends.
Common next steps from Research Scientist positions include Research Lead, Distinguished Scientist, VP of Research. Progression depends on whether you lean toward technical depth, people management, or product strategy.

Get Weekly AI Career Intelligence

Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.