Big Data Quality Engineer Consultant

Job Description and Duties

The Information Technology, Network Operations program at State Fund currently has an opening for a Information Technology Specialist II classification as a Big Data Quality Engineer.

The position's major functions are as follows:

• Testing applications built on Big Data.

• Testing using SQL and PL/SQL.

• Testing using NoSQL systems like HBase or Cassandra.

• Testing applications implemented in Cloudera Distribution 6.x.

• Testing Solr collections in Solr Cloud environment.

• Validating data pipelines using Hadoop components Sqoop, Hive, Solr, MR, Impala, Spark, Spark SQL.

• Testing using Hive QL and UDF’s for analyzing semi structured/structured datasets.

• Testing application modules and functionalities implemented using Spring framework, Web Services and REST API's.

• Testing REST API’s using tools like Postman and SoapUI.

• Testing ingestion and processing of various file formats like Avro/Parquet/Sequence Files/Text Files etc.

• Testing data warehousing and Business Intelligence systems.

• Handling all technical aspects of testing which includes delivering effective testing strategies and testing artifacts like Test Plans, Test Cases, Testing Execution Reports etc.

• Testing using required modules and features in HP ALM and JIRA.

• Providing test estimates for proposed projects.

• Constantly look for opportunities to improve testing processes.

• Encourage innovation of process and creative testing methodologies.

• Work closely with management on testing assignments.

• Promote high quality of testing and timely completion of testing assignments.

• Knowledge of Test Automation Scripting for both, BDD/TDD and Hybrid, linear test frameworks.

• Testing APIs using service based Automation Scripting.

You will find additional information about the job in the .

Working Conditions

Special Requirements

Effective July 1, 2025, the State of California implemented the Personal Leave Program 2025 (PLP 2025) which reduces an employee’s monthly salary in exchange for leave credits. Employees appointed to this classification will have their monthly salary reduced and will accrue hours of PLP 2025 on the first day of each pay period in accordance with the applicable The salary range(s) included on this job posting do not reflect the reduction in pay.

To be considered, you must provide a fully completed STD 678 application, resume, and statement of qualifications. Alternative documents submitted in lieu of required Application, Resume, or Statement of Qualifications will not be accepted. Completed STD 678 must include duties performed, start and end dates, and hours worked per week for each position held.

Artificial intelligence (AI) tools such as ChatGPT, website searches, and third-party reviewers can be helpful in researching responses to the SOQ; however, by submitting your application for this position, you understand and acknowledge the SOQ you submit is your own work, in your own words, and accurately reflects your knowledge, skills, abilities, and experiences. Submitting an SOQ that is not your own may be cause for disqualification from the hiring process.

Desirable Qualifications

In addition to evaluating each candidate's relative ability, as demonstrated by quality and breadth of experience, the following factors will provide the basis for competitively evaluating each candidate:

The successfull candidate shall possess the following skills:

• 4+ years of hands-on testing experience for applications built on Big Data.

• 5+ years of experience in SQL and relational database design and methods for data retrieval.

• Business domain knowledge related to Worker's Compensation Insurance industry is a plus.

• Knowledge of NoSQL systems like HBase or Cassandra.

• Knowledge of Cloudera Distribution 6.x.

• Knowledge of Solr collections in Solr Cloud environment.

• Knowledge of data pipelines using Hadoop components Sqoop, Hive, Solr, MR, Impala, Spark, Spark SQL.

• Experience with developing Hive QL, UDF’s for analyzing semi structured/structured datasets.

• Experience with Spring framework, Web Services and REST API's.

• Experience with testing REST API’s using tools like Postman and SoapUI.

• Knowledge of Test Planning, Reporting and Defect Management process in HP ALM & JIRA.

• Experience with testing ingestion and processing of various file formats like Avro/Parquet/Sequence Files/Text Files etc.

• Experience in testing data warehousing and Business Intelligence systems.

• Expert in all technical aspects of testing which includes delivering effective testing strategies and testing artifacts like Test Plans, Test Cases, Testing Execution Reports etc.

• Providing test estimates for proposed projects.

• Knowledge of Test Automation Scripting using Selenium, TestNg, AutoIT, Grid & Webdriver, xPath utilities, custom reports, trend analysis, file difference / compare tools, Protractor, Watir for both, BDD/TDD and Hybrid, linear test frameworks.

• Experience in testing APIs using service based Automation Scripting.

Benefits

State Fund employees are eligible for a number of benefits. Our benefit package includes:

Health Benefits Program (CalPERS)

Retirement (CalPERS)

Employer Health and Consolidated Benefits Contributions

Dental, Vision

401(k) and 457 Deferred Compensation Plans

Employee Assistance Program

Group Legal Services Insurance

Holidays, Vacation/Sick/Other Paid Leave

Flex Elect Reimbursement Program

Wellness and Recognition

Alternate Work Schedules

Transit Pass Program

Tuition Reimbursement

Dependent Scholarship Program

Leadership Training

Mentoring Program

Background Investigation

Prior to employment with State Compensation Insurance Fund, a background investigation (BI) will be initiated.

Required Application Package Documents

The following items are required to be submitted with your application. Applicants who do not submit the required items timely may not be considered for this job:

• Current version of the State Examination/Employment Application STD Form 678 (when not applying electronically), or the Electronic State Employment Application through your Applicant Account at All Experience and Education relating to the Minimum Qualifications listed on the Classification Specification should be included to demonstrate how you meet the Minimum Qualifications for the position.
• Resume is required and must be included.