Mod 1 Flashcards
What is the definition of AI?
Machines performing tasks that normally require human intelligence.
What does ML stand for, and what does it involve?
ML stands for Machine Learning, which involves training machines to display AI behavior.
List the common elements of AI/ML definitions under new and emerging law: TARO.
- Technology
- Automation
- Role of humans
- Output
What does it mean that an AI system is a socio-technical system?
AI systems are not just technical tools but also have a social impact on the people who use them.
Why is cross-disciplinary collaboration important in AI development?
To ensure experts from UX, anthropology, sociology, and linguistics are involved and valued.
What are the five dimensions of the OECD framework for the classification of AI systems?
- People and planet
- Economic context
- Data and input
- AI model
- Tasks and output
What are some use cases and benefits of AI?
- Recognition
- Event detection
- Forecasting
- Personalization
- Interaction support
- Goal-driven optimization
- Recommendation
What is the difference between strong/broad AI and weak/narrow AI?
Narrow AI can only perform one task or a narrow set of tasks, while General AI can mimic human thinking and learning.
Define supervised learning in machine learning.
- A subset of machine learning where the model is trained on labeled input data with known desired outputs.
- These two groups of data are sometimes called predictors and targets, or independent and dependent variables, respectively.
- This type of learning is useful for classification or regression. The former refers to training an AI to group data into specific categories and the latter refers to making predictions by understanding the relationship between two variables.
What is semi-supervised learning?
A subset of machine learning that combines both supervised and unsupervised learning using a small amount of labeled data and a large amount of unlabeled data.
. This avoids the challenges of finding large amounts of labeled data for training the model.
Generative AI commonly relies on semi-supervised learning.
Explain unsupervised learning.
A subset of machine learning where the model is trained to find patterns in unclassified data with minimal human supervision.
The AI is provided with preexisting unlabeled datasets and then analyzes those datasets for patterns. This type of learning is useful for training an AI for techniques such as clustering data (outlier detection, etc.) and dimensionality reduction (feature learning, principal component analysis, etc.). Most cost efficient
What is reinforcement learning?
A type of machine learning where agents learn to make decisions through rewards and punishments.
Like reinforcement for children. Self driving cars, rewards/punishment
What is a transformer in the context of AI?
A neural network architecture that learns context and maintains relationships between sequence data using attention mechanisms.
t does so by leveraging the technique of attention, i.e. it focuses on the most important and relevant parts of the input sequence. This helps to improve model accuracy. For example, in language-learning tasks, by attending to the surrounding words, the model is able to comprehend the meaning of a word in the context of the whole sentence.
t does so by leveraging the technique of attention, i.e. it focuses on t
What defines a multimodal model?
A model that can process more than one type of input or output data simultaneously.
What is generative AI?
A field of AI that uses deep learning trained on large datasets to create new content, such as written text, code, images, music, simulations and videos. Unlike discriminative models, Generative AI makes predictions on existing data rather than new data. These models are capable of generating novel outputs based on input data or user prompts.
Define deep learning.
A subfield of AI and machine learning that uses artificial neural networks. Deep learning is especially useful in fields where raw data needs to be processed, like image recognition, natural language processing and speech recognition.
What is natural language processing (NLP)?
A subfield of AI that enables computers to understand, interpret, and manipulate human language.
How does robotics differ from robotic process automation (RPA)?
Robotics involves designing machines for tasks without human intervention, while RPA uses machines for repetitive tasks.
What is the AI technology stack composed of?
- Platforms and applications (Platform=Sofware to develop/test) (AI app=HOW system is used)
- Model types
- Compute infrastructure
What is compute infrastructure?
Democratization of AI - everyone can use AI
Tuning to customize model. Change hyper parameters. Varies based on complexity
Transform data to ingest into AI model. Data compatibility.
Labeling - enrich data to use for deployment . High quality and standard
What are the model types?
Linear & Statistical models - relationship between 2 variables. Very explainable
Decision Tree - flowchart of Q & As. Subject to hacks
Neural network (ML models) - neural network. Blackbox and lack transparency & explainability
Vision recognition, speech recognition
Language models (NLP models) - Process speech
Reinforcement learning - feedback training. Earn a high score
Robotics application - no human intervention
What was significant about the 1956 Dartmouth summer research project?
It was when the term ‘AI’ was coined.
1950s to 1970s - LISP and Eliza - NLP
Mid 1970s - mid 1980s - slowdown like lighthill report in UK challenged feasibility and practicality
Mid to late 1980s - expert systems and japan
Late 1980s to 1990s - decline in interest and funding
Late 1990s - 2011 - Big data from internet boom and Deep blue chess in 1997
2011 to present - Open AI and AlphaGo
Understand how the current environment is fueled by exponential growth in computing infrastructure and tech megatrends (cloud, mobile, social, IOT, PETs, blockchain, computer vision, AR/VR, metaverse).
Cloud - accessibility
Mobile - Explosion of data to learn from
IoT - wealth of data
PETs - viable approach to addressing security and privacy concerns
Computer vision - Efficient and interactive human machine interactions
AR/VR -
Metaverse
What are some core risks and harms posed by AI systems?
- Bias
- Implicit bias
- Sampling bias
- Temporal bias
- Overfitting
- Edge cases & outliers