PyRIT

What it is

A Python framework from the Microsoft AI Red Team for running red-team attacks against generative AI systems, either automated or led by a person. The name stands for Python Risk Identification Tool.

What it helps with

- Running single-turn and multi-turn attack strategies against a model or AI app
- Scoring the replies to see which attempts got through
- Keeping a record of every conversation for later review

Who it's for

Security professionals and engineers red-teaming generative AI systems they own or are authorized to assess.

Worth knowing

The current repository is microsoft/PyRIT. The older Azure/PyRIT repository is archived.

Is there a graphical interface?
Yes. CoPyRIT is a graphical interface for red-team sessions led by a person.

Does it only test Microsoft models?
No. It can target many kinds of generative AI systems, not only Microsoft ones.