phi 2

Phi-2 punches well above its weight class for a 2.8B parameter model, showing surprisingly strong reasoning and coding ability relative to its size. It was trained with a heavy focus on 'textbook quality' data, which gives it a clean, structured way of explaining concepts. However, its small size means it can struggle with complex multi-step tasks and has limited world knowledge compared to larger models.