What is Gennerative AI Flashcards
Describe Generative AI (19 cards)
What is Generative AI (Gen AI)?
A subset of deep learning that generates new data similar to the data it was trained on.
What types of data can Generative AI be trained on?
- Text
- Images
- Audio
- Code
- Video
- Other types of data
What is a foundation model?
A broad and large model that can adapt to different general tasks such as generating and summarizing text, extracting information, generating images, and answering questions.
Why are foundation models expensive to train?
They require significant computational power, time, and vast amounts of data.
Name a foundation model developed by OpenAI.
GPT-4o
What is an example of an open-source foundation model?
Google BERT
What is a Large Language Model (LLM)?
A type of AI that relies on a foundation model and is designed to generate coherent human-like text.
How does an LLM generate text?
It uses a prompt to generate responses based on learned content and internal probabilities.
What does it mean when the output of an LLM is described as non-deterministic?
The same prompt may yield different answers due to statistical methods used in generation.
What is the purpose of a prompt in LLM usage?
It is a question or text input that guides the LLM to generate a specific response.
What is the forward diffusion process in image generation?
Adding noise to an image over time until it becomes unrecognizable.
What is the reverse diffusion process?
Starting from noise and de-noising it to generate a coherent image based on a prompt.
What is an example of a prompt for image generation?
Generate a blue sky with white clouds and the word ‘Hello’ written in the sky.
True or False: LLMs can perform tasks such as translation and summarization.
True
Fill in the blank: Generative AI combines knowledge into ______ ways.
[new and unique]
What does the term ‘parameters’ refer to in LLMs?
The billions of variables that the model uses to process and generate text.
What happens when an LLM generates text based on probabilities?
It selects words based on likelihoods, leading to variability in output.
List some companies known for creating foundation models.
- OpenAI
- Meta
- Amazon
- Anthropic
What are some tasks that a foundation model can perform?
- Generate text
- Summarize text
- Extract information
- Generate images
- Act as a chatbot
- Answer questions
