CS362 - Final Flashcards
(41 cards)
Word Embedding
Representing words as continuous-valued vectors in lower dimensions.
Week 6: Deep Learning for Natural Language Processing
Sequence-to-Sequence (Seq2Seq)
Models that map input sequences to output sequences.
Week 6: Deep Learning for Natural Language Processing
Transformer
A deep learning model using self-attention for sequence tasks.
Week 6: Deep Learning for Natural Language Processing
Text Preprocessing
Steps like tokenization, lowercasing, stemming for preparing text.
Week 6: Deep Learning for Natural Language Processing
Bag-of-Words
Text representation ignoring word order, using word frequency.
Week 6: Deep Learning for Natural Language Processing
Agent
An entity that perceives its environment and acts to achieve goals.
Week 8: Intelligent Agents & Reinforcement Learning
Environment
The external system an agent interacts with.
Week 8: Intelligent Agents & Reinforcement Learning
State
Current situation of the environment.
Week 8: Intelligent Agents & Reinforcement Learning
Action
Steps taken by the agent to transition states.
Week 8: Intelligent Agents & Reinforcement Learning
Policy
Mapping from states to actions.
Week 8: Intelligent Agents & Reinforcement Learning
Reward
Feedback received after an action.
Week 8: Intelligent Agents & Reinforcement Learning
Episode
A complete sequence of states, actions, and rewards.
Week 8: Intelligent Agents & Reinforcement Learning
Passive RL
Learning utility of states with a fixed policy.
Week 8: Intelligent Agents & Reinforcement Learning
Active RL
Learning optimal policy through exploration.
Week 8: Intelligent Agents & Reinforcement Learning
Generalization in RL
Ability of learned policies to work in new environments.
Week 8: Intelligent Agents & Reinforcement Learning
Robot
A physical agent that performs tasks in the physical world.
Week 9: Robotics
Effector
Part of a robot (e.g., gripper) that interacts with the environment.
Week 9: Robotics
Actuator
Drives motion in robot components.
Week 9: Robotics
Perception
The robot’s ability to understand surroundings using sensors.
Week 9: Robotics
Collaborative Robot (Cobot)
Designed to work safely alongside humans.
Week 9: Robotics
Social Robot
Interacts with humans using social norms.
Week 9: Robotics
Python
Most common programming language in AI.
Week 10: AI Languages, Libraries, Tools, and Hardware
NumPy
Library for numerical computation in Python.
Week 10: AI Languages, Libraries, Tools, and Hardware
PyTorch
Deep learning framework by Meta.
Week 10: AI Languages, Libraries, Tools, and Hardware