What it does
A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
Best for
Explore AI-assisted workflows, automate parts of your work and create useful first drafts faster.
A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
Explore AI-assisted workflows, automate parts of your work and create useful first drafts faster.
AI output can be inaccurate or incomplete. Features, privacy terms and usage limits can change, so verify important results on the provider website.