- Johns Hopkins University (Gaithersburg, MD)
- …This project focuses on using Large Language Models (LLMs) to provide annotations of evaluation data (aka, LLM as judge), and the design of an Inter-Annotator ... Agreement study to assess the reliability of both human and LLM annotations. The candidate will explore assessing the indicators of a given AI-related risk, determining how to identify them, and providing annotators with examples to annotate the presence of… more
- Johns Hopkins University (Gaithersburg, MD)
- …This project focuses on contributing to the development of a study on digital watermarking technologies. The student(s) will explore how watermarking techniques are ... used for protecting digital content and the challenges involved in evaluating their robustness, imperceptibility, and effectiveness. The project aims to build foundational understanding and draft an initial evaluation strategy, supporting broader work at NIST… more
- Johns Hopkins University (Gaithersburg, MD)
- …will include but are not limited to: + Learn and understand PDR system + Understand domain specific data and metadata standards + Use and explore AI techniques to ... support data visualization | Enhance the existing PDR system with these additions | Regular code updates, deliver code repo along with documentation | Attend regular meetings with NIST | A Bachelor's degree in Computer Science, Engineering, Manufacturing, or a… more
- Johns Hopkins University (Gaithersburg, MD)
- …will include but are not limited to: ? | Develop an understanding of the systems and processes of typical research data workflow. | Design, develop, test, and deploy ... PREP Research Associate ? ? This position is part of the National Institute of Standards (NIST) Professional Research Experience (PREP) program. NIST recognizes that its research staff may wish to collaborate with researchers at academic institutions on… more
- Johns Hopkins University (Gaithersburg, MD)
- …? Familiarize with NIST's work on AI risk and impact assessment and measuring contextual robustness, including needs for interactive data visualization in this ... context ? Create mockups of interactive data visualization tool(s) ? Research different toolkits available for interactive data visualization ? Propose system architecture(s) for the tool(s) ? Develop, test, and document interactive data visualization tool(s)… more
- Johns Hopkins University (Gaithersburg, MD)
- …This project contributes to the development of the Metrics Hub within the NIST's Trustworthy and Responsible Artificial Intelligence Resource Center (AIRC). The ... student will assist in collecting and packaging relevant metrics for AI testing, identifying key metadata that support the creation of accessible resources for the AIRC website, benefiting the broader AI community and the public. This project will support the… more
- Johns Hopkins University (Gaithersburg, MD)
- …will include but are not limited to: | Ability to explore measurement science data using information visualization and scientific visualization techniques in an ... PREP Research Associate This position is part of the National Institute of Standards (NIST) Professional Research Experience (PREP) program. NIST recognizes that its research staff may wish to collaborate with researchers at academic institutions on specific… more
- Johns Hopkins University (Gaithersburg, MD)
- …will include but are not limited to: | Become familiar with NIST's AI outputs and stakeholders | Perform a literature review and analysis on various approaches and ... PREP Research Associate This position is part of the National Institute of Standards (NIST) Professional Research Experience (PREP) program. NIST recognizes that its research staff may wish to collaborate with researchers at academic institutions on specific… more
- Johns Hopkins University (Gaithersburg, MD)
- …This project focuses on documenting the Assessing Risks and Impacts of AI (ARIA) dataset, which is used to evaluate risks as part of a NIST ARIA Program. The student ... will assist in the design and development of a comprehensive dataset card aligned with emerging standards for AI, including the principles of transparency, reliability, and reproducibility. This work supports the advancement of rigorous, standardized data… more
- Johns Hopkins University (Gaithersburg, MD)
- …will include but are not limited to: + Learn and understand PDR system functionality + Understand domain specific data and metadata standards + API optimization and ... PREP Research Associate This position is part of the National Institute of Standards (NIST) Professional Research Experience (PREP) program. NIST recognizes that its research staff may wish to collaborate with researchers at academic institutions on specific… more