Herbie Bradley – EleutherAI – Speeding up inference of LLMs with Triton and FasterTransformer

Herbie is a PhD student in AI at the University of Cambridge working on large language models and open-endedness. He also leads several projects at the open-source distributed research group EleutherAI on code generation, reward modeling, and interpretability.