Simon A.T. Jiménez

Three years of putting LLMs into Software - Lessons learned

What if LLMs are just a new, unreliable kind of API? Learn the critical lessons from three years of building real-world software with them.

Three years of putting LLMs into Software - Lessons learned
#1about 4 minutes

Understanding the fundamental nature of LLMs

LLMs are unreliable pattern matchers that appear intelligent but lack true understanding, requiring developers to manage context and anticipate failures.

#2about 4 minutes

Controlling LLM output with API parameters

API parameters like temperature and top_p allow for control over the determinism and creativity of LLM responses by manipulating token selection probabilities.

#3about 7 minutes

Viewing LLMs as a new kind of API

LLMs should be treated as a new type of API for text manipulation, not as intelligent agents, because they are advanced pattern matchers with significant limitations.

#4about 5 minutes

Implementing practical LLM use cases in software

LLMs can be used for tasks like audio transcription, image analysis for OCR, and text reformulation by providing clear instructions and examples in the prompt.

#5about 4 minutes

Navigating legal compliance and data privacy

Using paid APIs with data privacy contracts, implementing human-in-the-loop workflows, and understanding the European AI Act are crucial for legal compliance.

#6about 2 minutes

Understanding the security risks of AI integrations

Integrating LLMs with external APIs or internal data creates significant security risks like prompt injection, requiring careful control over the AI's permissions and actions.

Related jobs
Jobs that call for the skills explored in this talk.

Remote

Name of

Name of

Remote
Intermediate
PHP
Java
+1

Matching moments

Three pillars for integrating LLMs in products
01:47 MIN

Three pillars for integrating LLMs in products

Using LLMs in your Product

Unlock Moments
Create a free account to watch a limited number of Moments each month.
Upgrade to PRO for unlimited access to the full archive.
Why natural voice AI has been so difficult
04:47 MIN

Why natural voice AI has been so difficult

Hello JARVIS - Building Voice Interfaces for Your LLMS

Unlock Moments
Create a free account to watch a limited number of Moments each month.
Upgrade to PRO for unlimited access to the full archive.
Addressing the core challenges of large language models
05:18 MIN

Addressing the core challenges of large language models

Accelerating GenAI Development: Harnessing Astra DB Vector Store and Langflow for LLM-Powered Apps

Unlock Moments
Create a free account to watch a limited number of Moments each month.
Upgrade to PRO for unlimited access to the full archive.
Addressing the key challenges of large language models
02:55 MIN

Addressing the key challenges of large language models

Large Language Models ❤️ Knowledge Graphs

Unlock Moments
Create a free account to watch a limited number of Moments each month.
Upgrade to PRO for unlimited access to the full archive.
Demonstrating LLM hallucinations with tricky questions
06:55 MIN

Demonstrating LLM hallucinations with tricky questions

Give Your LLMs a Left Brain

Unlock Moments
Create a free account to watch a limited number of Moments each month.
Upgrade to PRO for unlimited access to the full archive.
The rapid evolution and adoption of LLMs
02:35 MIN

The rapid evolution and adoption of LLMs

Building Blocks of RAG: From Understanding to Implementation

Unlock Moments
Create a free account to watch a limited number of Moments each month.
Upgrade to PRO for unlimited access to the full archive.
Using large language models as a learning tool
03:42 MIN

Using large language models as a learning tool

Google Gemini: Open Source and Deep Thinking Models - Sam Witteveen

Unlock Moments
Create a free account to watch a limited number of Moments each month.
Upgrade to PRO for unlimited access to the full archive.
Understanding the problem of LLM hallucinations
02:29 MIN

Understanding the problem of LLM hallucinations

Martin O'Hanlon - Make LLMs make sense with GraphRAG

Unlock Moments
Create a free account to watch a limited number of Moments each month.
Upgrade to PRO for unlimited access to the full archive.

Featured Partners

Related Videos

See all videos
Using LLMs in your Product31:12

Using LLMs in your Product

Daniel Töws

Inside the Mind of an LLM27:11

Inside the Mind of an LLM

Emanuele Fabbiani

Bringing the power of AI to your application.32:26

Bringing the power of AI to your application.

Krzysztof Cieślak

Hello JARVIS - Building Voice Interfaces for Your LLMS28:13

Hello JARVIS - Building Voice Interfaces for Your LLMS

Nathaniel Okenwa

You are not my model anymore - understanding LLM model behavior24:11

You are not my model anymore - understanding LLM model behavior

Andreas Erben

AI: Superhero or Supervillain? How and Why with Scott Hanselman25:17

AI: Superhero or Supervillain? How and Why with Scott Hanselman

Scott Hanselman

Self-Hosted LLMs: From Zero to Inference30:04

Self-Hosted LLMs: From Zero to Inference

Roberto Carratalá & Cedric Clyburn

Exploring LLMs across clouds28:38

Exploring LLMs across clouds

Tomislav Tipurić

Related Articles

View all articles
DC
Daniel Cranney
Stephan Gillich - Bringing AI Everywhere
In the ever-evolving world of technology, AI continues to be the frontier for innovation and transformation. Stephan Gillich, from the AI Center of Excellence at Intel, dove into the subject in a recent session titled "Bringing AI Everywhere," sheddi...
Stephan Gillich - Bringing AI Everywhere
CH
Chris Heilmann
Exploring AI: Opportunities and Risks for Developers
In today's rapidly evolving tech landscape, the integration of Artificial Intelligence (AI) in development presents both exciting opportunities and notable risks. This dynamic was the focus of a recent panel discussion featuring industry experts Kent...
Exploring AI: Opportunities and Risks for Developers

From learning to earning

Jobs that call for the skills explored in this talk.

AI Prompt Engineer

AI Prompt Engineer

SonarSource

Remote
Data analysis
Machine Learning
Natural Language Processing