- Johns Hopkins University (Gaithersburg, MD)
- …will include but are not limited to: ? | Develop an understanding of the systems and processes of typical research data workflow. | Design, develop, test, and deploy ... PREP Research Associate ? ? This position is part of the National Institute of Standards (NIST) Professional Research Experience (PREP) program. NIST recognizes that its research staff may wish to collaborate with researchers at academic institutions on… more
- Johns Hopkins University (Gaithersburg, MD)
- …will include but are not limited to: | Become familiar with NIST's AI outputs and stakeholders | Perform a literature review and analysis on various approaches and ... PREP Research Associate This position is part of the National Institute of Standards (NIST) Professional Research Experience (PREP) program. NIST recognizes that its research staff may wish to collaborate with researchers at academic institutions on specific… more
- Johns Hopkins University (Gaithersburg, MD)
- …This project focuses on using Large Language Models (LLMs) to provide annotations of evaluation data (aka, LLM as judge), and the design of an Inter-Annotator ... Agreement study to assess the reliability of both human and LLM annotations. The candidate will explore assessing the indicators of a given AI-related risk, determining how to identify them, and providing annotators with examples to annotate the presence of… more
- Johns Hopkins University (Gaithersburg, MD)
- …will include but are not limited to: + Learn and understand PDR system + Understand domain specific data and metadata standards + Use and explore AI techniques to ... support data visualization | Enhance the existing PDR system with these additions | Regular code updates, deliver code repo along with documentation | Attend regular meetings with NIST | A Bachelor's degree in Computer Science, Engineering, Manufacturing, or a… more
- Johns Hopkins University (Gaithersburg, MD)
- …This project focuses on documenting the Assessing Risks and Impacts of AI (ARIA) dataset, which is used to evaluate risks as part of a NIST ARIA Program. The student ... will assist in the design and development of a comprehensive dataset card aligned with emerging standards for AI, including the principles of transparency, reliability, and reproducibility. This work supports the advancement of rigorous, standardized data… more
- Johns Hopkins University (Gaithersburg, MD)
- …This project contributes to the development of the Metrics Hub within the NIST's Trustworthy and Responsible Artificial Intelligence Resource Center (AIRC). The ... student will assist in collecting and packaging relevant metrics for AI testing, identifying key metadata that support the creation of accessible resources for the AIRC website, benefiting the broader AI community and the public. This project will support the… more
- Johns Hopkins University (Gaithersburg, MD)
- …will include but are not limited to: + Learn and understand PDR system functionality + Understand domain specific data and metadata standards + API optimization and ... PREP Research Associate This position is part of the National Institute of Standards (NIST) Professional Research Experience (PREP) program. NIST recognizes that its research staff may wish to collaborate with researchers at academic institutions on specific… more
- Johns Hopkins University (Gaithersburg, MD)
- …will include but are not limited to: + Developing methodology to assess various dimensions of the "goodness" of scenarios for AI evaluations, such as, but not limited ... to: + Measurability of risks and benefits in AI scenarios , both at the individual and organizational levels. + Applicability of scenarios to various evaluation types, such as evaluations to elicit negative impacts (eg, risks), evaluations to elicit positive… more
- Johns Hopkins University (Gaithersburg, MD)
- …will include but are not limited to: - Implementing optimized calculations to study AI classification algorithms. - Assessing uncertainty in classification of ... experimental data. - Computationally testing mathematical models relating uncertainty quantification. - Significant software development (most likely python) - Disseminating results through posters/seminars at meetings and seminars - Ensuring that all results,… more
- Johns Hopkins University (Gaithersburg, MD)
- …will include but are not limited to: + Learn and understand PDR system functionality + Determine various AI techniques which we can use to improve search experience + ... PREP Research Associate This position is part of the National Institute of Standards (NIST) Professional Research Experience (PREP) program. NIST recognizes that its research staff may wish to collaborate with researchers at academic institutions on specific… more