Data Scientist
Duration: 12+ Months contract with extension
Location: Elk Grove, CA or Austin, TX Or Sunnyvale, CA (Onsite on every Tuesday, Wednesday, and Thursday)About the Role
We are seeking a highly analytical Data Researcher with a strong background in Data Science, Experimental Research, and Generative AI to evaluate the effectiveness of AI-powered analytics agents.
This role is ideal for someone who enjoys applying scientific methodology to solve complex problems. Rather than simply building AI solutions, you will rigorously design experiments, evaluate AI agent performance, analyze results, and provide evidence-based recommendations on whether Generative AI can reliably answer analytical questions.
The successful candidate will combine expertise in Python, SQL, Snowflake, AI/LLM technologies, statistical experimentation, and research methodology to build reproducible experiments and measure AI system performance.Key Responsibilities
- Design, build, and evaluate Generative AI-powered analytics agents.
- Develop controlled experiments to evaluate AI agent performance.
- Form hypotheses and design statistically sound research methodologies.
- Measure model accuracy, repeatability, reliability, and failure modes.
- Analyze experimental results and communicate findings with quantitative evidence.
- Evaluate different LLM configurations including prompting strategies, model parameters, RAG, and agent architectures.
- Define analytical metrics and establish evaluation baselines.
- Create reproducible research documentation, structured experiment logs, and technical reports.
- Collaborate with Data Scientists, AI Engineers, Product teams, and business stakeholders.
- Present research findings and recommendations to technical and executive audiences.
- Bachelor's or Master's degree in Computer Science, Data Science, Statistics, Machine Learning, Artificial Intelligence, or a related discipline.
- 5+ years of experience in Data Science using:
- Python
- SQL
- Snowflake
- 3+ years of experience designing and conducting controlled experiments, including:
- Hypothesis testing
- Experimental design
- Baseline creation
- Bias reduction
- Statistical evaluation
- 3+ years evaluating ML models or AI systems using:
- Error analysis
- Variability measurement
- Reproducibility testing
- Performance benchmarking
- 1+ year of hands-on experience with Generative AI, including:
- LLMs
- Prompt Engineering
- AI Agents
- Retrieval-Augmented Generation (RAG)
- API-based model interaction
- Model parameter tuning (temperature, top-p, etc.)
- Strong understanding of:
- Statistical analysis
- Data quality
- Analytical metrics
- Experimental research
- Experience maintaining reproducible research documentation.
- Excellent communication and presentation skills.
- Experience evaluating Large Language Models (LLMs) for correctness, consistency, and repeatability.
- Experience with Tableau or other BI/Visualization platforms.
- Experience in Operations, Support, or IT Analytics.
- Experience presenting research findings to leadership or executive stakeholders.
- Familiarity with LangChain, LangGraph, CrewAI, AutoGen, or similar AI agent frameworks.
PTR Global is a leading provider of information technology and workforce solutions. PTR Global has become one of the largest providers in its industry, with over 5000 professionals providing services across the U.S. and Canada. For more information visit www.ptrglobal.com
At PTR Global, we understand the importance of your privacy and security. We NEVER ASK job applicants to:
- Pay any fee to be considered for, submitted to, or selected for any opportunity.
- Purchase any product, service, or gift cards from us or for us as part of an application, interview, or selection process.
- Provide sensitive financial information such as credit card numbers or banking information. Successfully placed or hired candidates would only be asked for banking details after accepting an offer from us during our official onboarding processes as part of payroll setup.
The specific compensation for this position will be determined by several factors, including the scope, complexity, and location of the role, as well as the cost of labor in the market; the skills, education, training, credentials, and experience of the candidate; and other conditions of employment. Our full-time consultants have access to benefits, including medical, dental, vision, and 401K contributions, as well as PTO, sick leave, and other benefits mandated by applicable state or localities where you reside or work.
If you receive a suspicious message, email, or phone call claiming to be from PTR Global, do not respond or click on any links. Instead, contact us directly at +1 214-740-2424. To report any concerns, please email us at [email protected] #LI-NP3
Recommended Jobs
Community Liaison/ First Responder
Job Description Job Description Salary: DOE Title: Community Liaison/ First Responder Department/Division: Social Services Status: Part-time & Full-time / Flexible schedule (availabilit…
Tagging Clerk (PM) Plant 1
Job Description Job Description Job Title: Tagging Clerk PM Non-Supervisory Position Reports To: Packing Manager …
Genesis Salesperson
Job Description Job Description Location: Irvine, CA (On Site) | Type: Full Time | Commission-Based Luxury Sales Career Norm Reeves Dealerships is a nationally-recognized group of private…
Studio Engineer
Bartech Staffing is a leading engineering, technical and professional staffing firm, and our clients include some of the nation's biggest companies. We are powered by Impellam Group, a connected grou…
Computer Systems Administration Career Training Program
Year Up United is a one-year or less, intensive job training program that provides young adults with in-classroom skill development, access to internships and/or job placement services, and personali…
Member of Technical Staff, Trading (Derivatives)
At Anchorage Digital, we are building the world’s most advanced digital asset platform for institutions to participate in crypto. Anchorage Digital is a crypto platform that enables institutions to …
District Manager I
I. Job Summary WM is seeking a motivated and ambitious District Manager to develop the skills needed to lead the daily operations of a district in Woodland, CA. This role provides a unique oppo…
Travel Radiology Tech Multimodality Technologist Job
Job Description Are you a skilled Radiology Tech looking to embark on an exciting travel healthcare assignment in Sonora, California? TLC Nursing has a fantastic opportunity for a Multimodality Tec…
Robotics Integration Engineer
Figure is an AI Robotics company developing a general purpose humanoid. Our Humanoid is designed for corporate tasks targeting labor shortages and jobs that are undesirable or unsafe. We are based in …
Tax Senior Associate, Asset Management
At KPMG, you can become an integral part of a dynamic team at one of the world's top tax firms. Enjoy a collaborative, future-forward culture that empowers your success. Work with KPMG's extensive ne…