
General
- What is machine learning? What are the different machine learning methods?
- Distinguish between Structured and Unstructured Data
Deep Learning
- What is Deep Learning? Discuss its key characteristics, working and applications
- What are the advantages and disadvantages of Deep Learning?
- How does Deep Learning methods compare with traditional Machine Learning methods?
- Explain the basic architecture of a Neural Network, model training and key hyper-parameters
- What is a Perceptron? What is the role of bias in a perceptron (or neuron)?
- What is a Multilayer Perceptron (MLP), also commonly known as Feed Forward Neural Network?
- What do you mean by pretraining, finetuning and transfer learning?
- What is an activation function, and what are the most common choices for activation functions?
- What are some options to address overfitting in Neural Networks?
- What is the vanishing and exploding gradient problem, and how are they typically addressed?
- Compare the different Sequence models (RNN, LSTM, GRU, and Transformers)
- What is Rectified Linear Unit (ReLU) activation function? Discuss its advantages and disadvantages
- What is the “dead ReLU” problem and, why is it an issue in Neural Network training?
- Briefly describe the architecture of a Recurrent Neural Network (RNN)
- What are the advantages and disadvantages of a Recurrent Neural Network (RNN)?
- What is backpropagation?
- How does dropout work?
- What is Long-Short Term Memory (LSTM)?
- What are generative adversarial networks (GANs), and how are they used in deep learning?
Transformers
- What are Transformers? Discuss the evolution and major breakthroughs in transformer models
- Explain the Transformer Architecture
- What are the primary advantages of transformer models?
- What are the limitations of transformer models?
- Explain Self-Attention, and Masked Self-Attention as used in Transformers
- What is Multi-head Attention and how does it improve model performance over single Attention head?
- Explain Cross-Attention and how is it different from Self-Attention?
Natural Language Processing (NLP)
- What is Natural Language Processing (NLP) ? List the different types of NLP tasks
- What are some common applications of natural language processing (NLP)?
- What are Language Models? Discuss the evolution of Language Models over time
- What is Bag-of-Words Model? Explain using example
- What are the advantages and disadvantages of Bag-of-Words model?
- What is topic modeling? Discuss its working, applications, and the pros and cons
- How is topic modeling used in text summarization?
- What is an n-gram model?
- What are word embeddings, and how are they used in NLP?
- What are generative models, and how are they used in machine learning?
Supervised Learning
- What is supervised learning? What are some common algorithms used in supervised learning
- Explain the concept of Linear Regression
- What are the assumptions in a Linear Regression model?
- What are the key evaluation criteria for Linear Regression model?
- What is classification, and discuss the different types of classification? What are some common classification algorithms?
- What is overfitting, and how can it be prevented in supervised learning?
- What is underfitting and how can it be prevented?
- What is Logistic Regression? Describe the process of how logistic regression is used to fit data
- What are the advantages and disadvantages of logistic regression?
- What is a naive bayes classifier? Explain how does Naive Bayes work
- What is the basic idea of Support Vector Machine (SVM) and Maximum Margin?
- What are common choices to use for kernels in SVM?
- What is the kernel trick in SVM?
- How do you evaluate the performance of a classification model? Discuss confusion matrix, precision, recall, F1-score in this context
- What is a ROC curve?
- How can you handle imbalanced datasets in classification tasks?
- What is the difference between a generative and a discriminative model?
- What does L1 regularization (Lasso) mean?
- What does L2 regularization (Ridge) mean?
Ensemble Learning
- What is a Decision Tree? What are the advantages and disadvantages of using a Decision Tree
- What is Bagging? How do you perform bagging and what are its advantages?
- What is Gradient Boosting? Describe how does the Gradient Boosting algorithm work
- Explain the concept and working of the Random Forest model
- What is XGBoost? How does it improve upon standard GBM?
- What is the difference between Adaboost and Gradient boost?
- What is the difference between Decision Trees, Bagging, Boosting and Random Forest?
- How is Gradient Boosting different from Random Forest?
- GBM vs Random Forest: which algorithm should be used when?
- Distinguish between a Weak learner and a Strong Learner
- What parameters can be tweaked for a Random Forest model? Explain in detail
Unsupervised Learning
- What is Unsupervised learning, and what are its main types?
- What is Clustering in unsupervised learning?
- What are some common clustering algorithms, and how do they work?
- How does dimensionality reduction help in unsupervised learning?
- Explain the difference between principal component analysis (PCA) and t-SNE
- What is Principal Component Analysis (PCA), and how does it differ from clustering?
- How do you evaluate the quality of clustering results in unsupervised learning?
- How does K-means work? What are some pros and cons of K-Means Clustering?
- What are some common distance metrics that can be used in clustering?
Data Preprocessing and Feature Engineering
- What is Feature Scaling? Explain the different feature scaling techniques
- What are some common Feature Engineering techniques?
- How are Categorical Features represented? (Explain both one-hot and ordinal encoding)
- What is the curse of dimensionality, and how does it affect machine learning models?
- How can you deal with outliers in your data?
- What is the difference between Feature Engineering and Feature Selection?
- What is Feature Standardization (or Z-Score Normalization), and why is it needed?
- How do you handle missing data in a dataset?
Model Evaluation and Optimization
- What is cross-validation, and why is it important in model evaluation?
- How are model hyper-parameters generally selected?
- What is the purpose of regularization in machine learning models?
- What is the bias-variance tradeoff and how do you balance it?
- What are learning curves, and how do they help in model assessment?
- How does gradient descent work, and how is it used in training machine learning models?
Statistics
- What is a p-value, and what is its significance?
- Describe a confidence interval
- Explain Bayes’ Theorem
- How would you conduct an A/B test?
- What is the difference between parametric and non-parametric models?
- What is the difference between Mean, Median and Mode? How to choose between mean and median to summarize data?
- How does Bayesian Statistics differ from the Frequentist paradigm?
- What is the Central Limit Theorem (CLT), and what are its implications for statistical inference?
- What is Skewness and Kurtosis?
Follow this link for Machine Learning Quizzes: