• Cybersecurity Ethics and LLM Evaluation Specialist

    Tetrad Digital Integrity LLC (MD)


    Tetrad Digital Integrity (TDI) is a leading-edge cybersecurity firm with a mission to safeguard and protect our customers from increasing threats and vulnerabilities in this digital age.

     

    We are seeking a highly skilled and experienced Cybersecurity Ethics & LLM Evaluation Specialist to contribute to a cutting-edge project. The core focus of this role is to test and evaluate a Large Language Model's (LLM) ability to make sound ethical decisions within the context of penetration testing and ethical hacking scenarios.

    RESPONSIBILITIES:

    + Crafting complex ethical dilemmas encountered in real-world cybersecurity practices to meticulously evaluate an model's capability against industry best practices, legal frameworks, and established ethical guidelines.

    + Design and write nuanced, realistic ethical dilemma questions and scenarios specifically tailored to penetration testing and ethical hacking. These scenarios should probe the LLM's understanding of reasoning through complex cyber constraints and ethical quandaries.

    + Develop effective prompts and responses based on the developed scenarios to elicit detailed responses from the LLM while adhering to relevant cybersecurity industry standards (e.g., NIST, ISO 27001).

    + Establish ethical guidelines and codes of conduct for cybersecurity professionals (e.g., from SANS, (ISC)², CREST, EC-Council).

    QUALIFICAITONS:

    + Bachelor's degree in Cybersecurity, Computer Science, or a related field.

    + 5+ years in penetration testing, ethical hacking, or security consulting.

    + Certifications: Certified Ethical Hacker (CEH), Offensive Security Certified Professional (OSCP)

    + Strong understanding of ethical hacking methodologies, experience with vulnerability assessment tools, and knowledge of legal and ethical considerations in cybersecurity.

    + Demonstrable, in-depth understanding and practical experience with: industry standards (e.g., NIST Cybersecurity Framework, OWASP Top 10, PTES).

    + Relevant laws and regulations pertaining to cybercrime, data privacy, and computer misuse.

    + Ethical guidelines and codes of conduct for cybersecurity professionals.

    + Proven ability to conceptualize and articulate complex technical and ethical scenarios in a clear and understandable manner.

    + Ability to write clear, concise, and well-structured prompts, evaluations, and reports.

    + Familiarity with a range of historical and contemporary cyber incidents and the ethical dilemmas they presented.

    + Foundational understanding of what Large Language Models are, how they generate responses, and their general capabilities and limitations. You do not need to be an AI developer, but you should understand how to interact with an LLM.

     

    TDI does business with the federal government, which restricts employment to individuals who are either US citizens or lawful permanent residents of the United States.

     

    •TDI is an Equal Opportunity Employer. Employment decisions are made based on individual qualifications, merit, and business needs. We do not discriminate in employment opportunities or practices based on race, color, religion, sex, or national origin, in accordance with applicable federal laws.”

     

    Powered by JazzHR