Menu
©2019 ProObject
Interested in matching your career to your job? Want to mix cutting-edge technology with challenging and rewarding work assignments?
ProObject’s culture is one of continual employee investment—we know that happy employees are engaged employees. Click to learn more
NIST Cybersecurity Compliance is not an option - it's a requirement! ProObject’s certified staff follow our unique CYBRX process to ensure that you are on the right track to cybersecurity compliance in just a few short weeks. - Contact us to get compliant!
Test Engineer/Performance Engineer

Position Description:

  • Tester Engineer analyzes system requirements and concept of operations documents, acquisition plans, and system descriptions to develop evaluation and test plans and procedures, prepare for and conduct the data collection and analysis, and report status and results. Supports the development of Government test and evaluation documentation e.g., Text & Evaluation (T&E) Strategy, Test & Evaluation Master Plan, Event Test Plans, Test Readiness Assessments, and T&E Reports.
  • Works with other test organizations to support T&E program integration.
  • Provides specialized T&E capabilities tailored to system functions, level, maturity, and performance areas..

 

Labor Requirements:

  • The Level 2 Test Engineer (TE) shall possess the following capabilities:
    • Conduct research into and apply knowledge of Government test and evaluation concepts and related engineering, acquisition, and operations activities as needed to support the T&E activities
    • Plan and Execute Performance Analysis
    • Review planned acquisition approaches to support T&E schedule alignment with decision maker needs for T&E support
    • Analyze performance risk areas to focus T&E planning
    • Specify, validate, and adapt Modeling and Simulation for T&E use
    • Apply Statistical Analysis of variations in performance behavior to characterize confidence in performance estimates
    • Select, develop, and use analysis tools
    • Execute the evaluation plan on data collected by Testing Tasks
    • Plan and Execute Performance Data Collection
    • Plan program and event level testing for collection of data required for analysis and to sync T&E events with supported decision points
    • Establish and employ Data and Configuration Management capabilities
    • Support Data Authentication group functions; and comply with program Discrepancy Reporting criteria and processes
    • Assess operation and system performance requirements for testability and criticality to frame and prioritize T&E objectives and enable evaluation planning
    • Coordinate with program Systems Engineering (SE) and review T&E-related SE information to leverage functional analysis, system descriptions, parameter selection and dependencies, Modeling and Simulation, and initial performance risk assessments to inform evaluation planning
    • Assess operational environments and priorities for evaluation attention and scenario selection, and to coordinate user participation in T&E
    • Plan program and event level risk-tailored performance estimation and analysis of system and operational Effectiveness and Suitability metrics & conditions; levels of T&E include inspection, demonstration, paper analysis, survey, simulation, and physical test
    • Design surveys for evaluation of Subject Matter Expert (SME) input and user assessments of performance
    • Participate in the T&E Working-level Integrated Product Team (WIPT) and/or Integrated Test Team for coordination of evaluation plans
    • Produce Evaluation Plans (metric framework, scenarios/threads, timelines, requirements/T&E cross-walk), Analysis Plans, Data Requirements, Risk Assessments, Evaluation Reports, Status reports; provide input to Government T&E products (e.g., Technology Readiness Assessments, Test & Evaluation Strategy, Test & Evaluation Master Plan, T&E Plans & Procedures and Test Readiness Reports)
    • Design data sampling schemes to optimize the information/resource balance and to control testing uncertainties
    • Select, coordinate, and calibrate Instrumentation, collection and data management tools, targets, and facilities
    • Ensure test readiness including training of test event participants re-conduct of the event; equipment readiness, and security, legal, and privacy compliance arrangements
    • Participate in T&E WIPT and/or integrated Test Team for coordination of data collection plans
    • Execute Testing and Data Collection per plan
    • Produce associated Test Plans, Procedures, and reports/Briefings, Data management Plan
    • Work directly with the Government sponsor to coordinate task implementation
    • Maintain knowledge of current and evolving agency, national, and international standards applicable to the system development of interest
  • The Level 3 Test Engineer (TE) shall possess the following capabilities:
    • All the capabilities listed for a Level 2 Test Engineer (see above)
    • Provide overall leadership of the T&E task and serve as primary liaison to the government for supporting contract coordination and task execution
    • Communicate issues and solutions to the broader government and contract management structure as requested by Leadership
    • Ensure the appropriate level of independence of the team from the solution provider to support government management of objectivity risk
    • Manage T&E resources and tasks; ensure quality assurance of test processes and products
    • Coordinate and integrate Evaluation and Testing tasks and products
    • Participate in T&E WIPT and/or Integrated Test Team as needed to ensure proper coordination of T&E activities
    • Drive innovation and responsiveness to program changes and evolving T&E status to help manage program risk; develop alternative courses of action, work-arounds, and fall-back positions with a recommendation course of action for each risk, monitor and re-evaluate risks at appropriate milestones.

 

Technical Skills Required:

  • Experience with HPC performance engineering and testing, including running benchmarks and documenting benchmarking results
  • Proficiency with standard Linux/Unix tools and scripting languages (e.g., Python, Bash, Perl)
  • Experience with developing, profiling, and optimizing parallel applications
  • Demonstrated ability to speed up an application or benchmark
  • Experience programming in a low-level language (C/C++, assembly)
  • Strong understanding of HPC architectures:
    • CPU architecture
    • Memory, Data Caches, TLB, Large Pages, etc.
    • Interconnect/High Speed Network
    • Storage (e.g., nVME), shared HPC parallel file systems, etc.
  • Experience with tuning the Linux Operating System
  • Experience with GPU-related software/libraries (CUDA, OpenCL, etc.)
  • Experience with the Atlassian Tool Suite (JIRA, Bitbucket, Confluence)

 

Special Technical Skills Desired:

  • Experience with multi-threading and parallel programming techniques (MPI, pthreads, OpenMP, etc.)
  • Experience with a wide variety of HPC related technologies and systems
  • Experience with data analytics, data warehousing, and/or data architecture
  • Knowledge of, and experience with, HPC applications and algorithms
  • Ability to multi-task in a fast-paced environment
  • Desire to implement experiments to optimize performance across the Agency’s entire HPC portfolio

 

Minimum Experience Required:

  • The Level 2 Test Engineer (TE):
    • Five (5) years’ experience as a TE in programs and contracts of similar scope, type and complexity is required. Bachelor’s degree in Math, Science, Engineering, Statistics, Engineering Management, or related discipline form an accredited college or university is required. Four (4) years of additional TE experience may be substituted for a bachelor’s degree.
  • The Level 3 Test Engineer (TE):
    • Eight (8) years’ experience as a TE in programs and contracts of similar scope, type and complexity is required. Bachelor’s degree in Math, Science, Engineering, Statistics, Engineering Management, or related discipline form an accredited college or university is required. Four (4) years of additional TE experience may be substituted for a bachelor’s degree.
  • TS/SCI with Polygraph Required

 

Previous Job Next Job