Generative AI Flashcards
(42 cards)
What is Generative AI?
Generative AI is a subset of Artificial Intelligence where an AI model creates original content in response to a natural language prompt, producing new outputs such as text, images, and code.
How do Large Language Models (LLMs) work?
LLMs work by recognizing patterns and making predictions based on vast amounts of text data. When given a prompt, an LLM predicts the next most likely word, adds it to the sequence, and repeats the process to generate coherent text.
What is the difference between LLMs and Small Language Models (SLMs)?
LLMs have billions or trillions of parameters for comprehensive language generation but can impact performance and are difficult to deploy locally. SLMs are trained on smaller, focused datasets, making them effective for specific topics and easier to fine-tune and deploy locally.
What are the two main components of a transformer model?
- Encoder - reads and understands input text, picking up meanings of words and their context. 2. Decoder - generates new text based on the encoder’s understanding, creating coherent sentences.
What is tokenization in transformer models?
Tokenization is the process of breaking down input text into smaller pieces called ‘tokens’ (words, parts of words, punctuation, emojis), each assigned a unique numeric identifier to allow computers to process and understand language.
What are embeddings in AI models?
Embeddings are special numeric codes (vectors) that each token is converted into after tokenization. These vectors capture the semantic meaning of words, where words with similar meanings have similar codes in multidimensional space.
What is positional encoding and why is it important?
Positional encoding is a technique that ensures the model retains the order of words in a sentence, as word order significantly impacts meaning in natural language.
What are attention layers in transformer models?
Attention layers help the model determine the importance of each word or token within a sentence in relation to other words. ‘Self-attention’ considers how other tokens influence a token’s meaning, while ‘multi-head attention’ applies multiple perspectives for richer understanding.
What is natural language generation in Generative AI?
Natural language generation is creating human-like text responses, such as cover letters, healthy breakfast ideas, or email drafts, based on natural language prompts.
How does AI image generation work?
AI image generation interprets natural language requests to generate appropriate images, like creating an elephant eating a plant-based burger or a florist business logo based on text descriptions.
What can AI code generation do for developers?
AI code generation assists software developers by writing code snippets, explaining code, adding documentation, refactoring, optimizing code, and generating test cases.
What is Azure OpenAI Service?
Azure OpenAI Service is Microsoft’s cloud solution for deploying, customizing, and hosting large language models from OpenAI, combining cutting-edge models with Azure’s security and scalability.
What are GPT-4 and GPT-3.5 models used for?
GPT-4 and GPT-3.5 models generate text and programming code from natural language prompts. GPT-3.5 Turbo is specifically optimized for conversations.
What are DALL-E models designed for?
DALL-E models are designed to create and edit images from text descriptions.
What is the purpose of embedding models in Azure OpenAI?
Embedding models convert text into numerical sequences for analysis and comparison of text similarity.
What does the Whisper model do?
Whisper transcribes and translates speech to text.
What is Azure OpenAI Studio?
Azure OpenAI Studio is a web-based environment for deploying, testing, and managing large language models (LLMs).
What are Copilots in AI?
Copilots are generative AI assistants integrated into applications, often as chat interfaces, to provide contextualized support for common tasks and boost productivity and creativity.
What does Microsoft Copilot for Microsoft 365 do?
Microsoft Copilot for Microsoft 365 assists with creating documents, spreadsheets, presentations, and managing emails.
How does GitHub Copilot help developers?
GitHub Copilot aids software developers with real-time code suggestions, documentation, and testing.
What is the function of Microsoft Bing Search Engine Copilot?
Microsoft Bing Search Engine Copilot generates natural language answers to search queries.
Who does Copilot for Azure assist?
Copilot for Azure assists infrastructure administrators in the Azure portal.
What does Microsoft Copilot for Security help with?
Microsoft Copilot for Security helps security professionals assess, mitigate, and respond to threats.
