As a Computer Engineering Specialist, you will contribute to the next generation of AI models by evaluating and refining responses from advanced large language models (LLMs) in the field of computer engineering. Your expertise in topics such as computer architecture, embedded systems, digital logic design, computer networks, or hardware-software integration will be crucial to ensuring the technical accuracy and quality of AI outputs. This role combines domain knowledge, attention to detail, and a passion for elevating data quality in AI systems.
Design and evaluate high-difficulty Computer Engineering prompts that probe the limits of AI models
Identify reasoning errors, weaknesses, and failure modes in model outputs
Apply adversarial prompting techniques to surface gaps in model understanding
Provide expert-level feedback on model responses for Computer Engineering
Collaborate with project leads to maintain high quality and consistency standards
PhD or MS in Computer Engineering or closely related fields (Computer Science, System Engineering, etc).
Solid understanding of Computer engineering principles, system design practices, and hardware/software development tools.
Prior experience with prompt engineering and stumping expert level models (max reasoning/tokens,Chain-of-thought)
Prior experience inducing/identifying reasoning related errors.
Excellent attention to detail, especially in technical communication and numerical accuracy.
Based out of the US, Canada, Mexico, UK, or Spain
Experience with Research
Teaching, tutoring, or curriculum development experience in Computer Engineering.
Prior experience as an expert reviewer on AI data labeling projects
Publications or technical writing in engineering disciplines.
Additional Information
Location: Fully remote (no visa sponsorship available)
Schedule: Flexible hours — contribute as much or as little as you’d like each week. (No minimum hours per week, capped at 40hrs/week.)