Evaluation engineer

Responsibilities:

As Agentic AI (GenAI) Benchmarking and Evaluation Engineer, you will work with world-class engineers at Qualcomm Research to evaluate ML software tools and algorithms to ensure they meet quality standards. As a member of our team, you will get a chance to learn latest cutting-edge technologies in machine learning and new emerging applications and participate in each step of the development process and drive quality improvements. You would be porting AI/ML solutions to various platforms and optimize the performance on multiple hardware accelerators (like CPU/GPU/NPU)

Youll collaborate with members of the software teams and plan a comprehensive evaluation approach. You will work with a small team of engineers to implement the evaluation strategy, deciding key performance metrics (KPIs), developing automation, and performing qualitative tests.

You will be responsible for developing a deep understanding of the ML algorithms developed in the project. You will apply tools and algorithms on wide variety of use cases, develop best practices, provide detailed analysis, extend research, and identify areas for further optimization. Perform in-depth benchmarking, and model evaluation, to ensure AI systems meet safety standards.

Required Skills:

• Exceptional software development skills with excellent analytical, development, and debugging skills.
• Strong understanding of Machine Learning fundamentals.
• Understanding of generative AI and its usage in various application
• Experience with LLM, LVM, LMM models, and other NN architectures.
• Proficiency in designing, implementing and training ML algorithms in high-level languages/frameworks (PyTorch and TensorFlow).
• Excellent interpersonal, written, and oral communications skills

Preferred Skills:

• MS or PhD in Computer Science/Engineering with 2+ years of professional or equivalent experience.
• 2 years of proven experience in software development for GenAI, machine learning or high-performance computing with strong programming skills in Python and software design.
• Familiarity with AI agent frameworks (like LangChain, LlamaIndex, Autogen).
• Experience using/integrating Qualcomm AI Stack products (e.g. QNN, SNPE, QAIRT).
• Experience with machine learning accelerators, optimizing algorithms for hardware acceleration cores, working with heterogeneous or parallel computing systems.
• Experience driving cross-functional projects, including close collaboration with AI application teams to translate product needs into evaluation frameworks.
• Design and develop generalized AI solutions, including RAG systems, to enhance user capabilities with our AI accelerators.
• Experience in Android/Linux or other embedded systems.

Minimum Qualifications:

Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.

Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e-mail[[email protected]]{target="_blank"}

or call Qualcomm's toll-free number found[here]( public article viewandsysparm article=KB0039028){target="_blank"}

. Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process. Qualcomm is also committed to making our workplace accessible for individuals with disabilities. (Keep in mind that this email address is used to provide reasonable accommodations for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries).

To all Staffing and Recruiting Agencies:

Our Careers Site is only for individuals seeking a job at Qualcomm. Staffing and recruiting agencies and individuals being represented by an agency are not authorized to use this site or to submit profiles, applications or resumes, and any such submissions will be considered unsolicited. Qualcomm does not accept unsolicited resumes or applications from agencies. Please do not forward resumes to our jobs alias, Qualcomm employees or any other company location. Qualcomm is not responsible for any fees related to unsolicited

resumes/applications.

EEO Employer: Qualcomm is an equal opportunity employer; all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or any other protected classification.

Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law.

Pay range

and Other Compensation and Benefits

$122,800.00 - $184,200.00

The above pay scale reflects the broad, minimum to maximum, pay scale for this job code for the location for which it has been posted. Even more importantly, please note that salary is only one component of total compensation at Qualcomm. We also offer a competitive annual discretionary bonus program and opportunity for annual RSU grants (employees on sales-incentive plans are not eligible for our annual bonus). In addition, our highly competitive benefits package is designed to support your success at work, at home, and at play. Your recruiter will be happy to discuss all that Qualcomm has to offer - and you can review more details about our US benefits at this[link]( MuHsrvlJSxx4yBCcjnDdYuCy0PCUABDhfhvOlhdubErcCDUMp9O-RUoHl4WQ6OhAasmuuZITZorC1Yt0GpYLmfly0bXb2hLBZberjmiT6wDkWT5wyqSuH7yHBaM-0ARNTNLLV4AZ qZE4k9rl24d3Y9CZC14RRiu198VTP-Lx9zee2pfRx15exBSTRhJwEe1JlVXen9jW79DAXHJLu9oP9fEpGEPzBufcasieRAMMZ hxF CO-zysnXuBr2iS4-zfIETonK9Jcx2BA ZqHMiJtCp-QK30kJlGrRvs ycYXsAmFOFITxRDnUbukzMsxK8UaN2D4ufDUgSsx1612XhxK4pRsmjZrH1HEO4RpJSdXA/" blank"}

.