Resources for LLM Engineering (2025)

Generative AI 2 Minutes

I build software wrapping LLM APIs. This requires me to monitor social media to understand what’s happening in the “weird world of LLMs”, build prototypes to check technical feasibility and finally build production ready features considering not just functionality, but cost, latency, monitoring and maintainability.

Below are some of my go-to resources which I frequently visit at different phases of this LLM engineering life cycle (as of June 2025). I prepared similar kind of lists in 2023 (link) and 2024 (link). But, things have changed a lot since then. Hence, here goes the latest one.

  • Chatbot Services: I always maintain a paid subscription for one of the below services. These services wrap the best language models with different kinds of tools (for searching internet, writing code, analyzing data, generating reports etc.) offering finest agents possible as of today.
  • Playgrounds: As developers, we need to build wrappers on models (raw APIs). Playgrounds are the best places to try different raw models without writing code.
  • LLM Leaderboards to review how different models rank against each other w.r.t intelligence (across various types of tasks), cost, API latency etc.
  • Developer friendly cookbooks: Internet is full of blogs, books and videos describing what to do, but, as a developer, I need to know how to do. That’s where I find the following resources super helpful. These offer code and prompts to build stuff (and it-turn help me learn by doing)
  • I heavily use AI Assisted Coding for development. It not only saves time, but also helps to get into the state of flow.
  • Newsletters
  • Courses
    • Deeplearning.ai (Short Courses): I find “learning by doing” (active learning) to be more effective & efficient than listening to a lecture on youtube or reading through a book. Short courses by deeplearning.ai exactly offers that.
  • Blogs
  • Videos

[Cover image was generated with ChatGPT]

Published

Leave a comment