Certified Machine Learning Professional practice test

1. Question 1 · 1

   Which of the following describes concept drift?

   Choose one answer.

   • Concept drift is when there is a change in the distribution of an input variable
   • Concept drift is when there is a change in the distribution of a target variable
   • Concept drift is when there is a change in the relationship between input variables and target variables
   • Concept drift is when there is a change in the distribution of the predicted target given by the model
   • None of these describe Concept drift

2. Question 2 · 1

   Which of the following is a reason for using Jensen-Shannon (JS) distance over a Kolmogorov-Smirnov (KS) test for numeric feature drift detection?

   Choose one answer.

   • All of these reasons
   • JS is not normalized or smoothed
   • None of these reasons
   • JS is more robust when working with large datasets
   • JS does not require any manual threshold or cutoff determinations

3. Question 3 · 1

   A data scientist is utilizing MLflow to track their machine learning experiments. After completing a series of runs for the experiment with experiment ID exp_id, the data scientist wants to programmatically work with the experiment run data in a Spark DataFrame. They have an active MLflow Client client and an active Spark session spark. Which of the following lines of code can be used to obtain run-level results for exp_id in a Spark DataFrame?

   Choose one answer.

   • client.list_run_infos(exp_id)
   • spark.read.format("delta").load(exp_id)
   • There is no way to programmatically return row-level results from an MLflow Experiment.
   • mlflow.search_runs(exp_id)
   • spark.read.format("mlflow-experiment").load(exp_id)

4. Question 4 · 1

   A data scientist has developed and logged a scikit-learn random forest model model, and then they ended their Spark session and terminated their cluster. After starting a new cluster, they want to review the feature_importances_ of the original model object. Which of the following lines of code can be used to restore the model object so that feature_importances_ is available?

   Choose one answer.

   • mlflow.load_model(model_uri)
   • client.list_artifacts(run_id)["feature-importances.csv"]
   • mlflow.sklearn.load_model(model_uri)
   • This can only be viewed in the MLflow Experiments UI
   • client.pyfunc.load_model(model_uri)

5. Question 5 · 1

   Which of the following is a simple statistic to monitor for categorical feature drift?

   Choose one answer.

   • Mode
   • None of these
   • Mode, number of unique values, and percentage of missing values
   • Percentage of missing values
   • Number of unique values

6. Question 6 · 1

   Which of the following is a probable response to identifying drift in a machine learning application?

   Choose one answer.

   • None of these responses
   • Retraining and deploying a model on more recent data
   • All of these responses
   • Rebuilding the machine learning application with a new label variable
   • Sunsetting the machine learning application

7. Question 7 · 1

   After a data scientist noticed that a column was missing from a production feature set stored as a Delta table, the machine learning engineering team has been tasked with determining when the column was dropped from the feature set. Which of the following SQL commands can be used to accomplish this task?

   Choose one answer.

   • VERSION
   • DESCRIBE
   • HISTORY
   • DESCRIBE HISTORY
   • TIMESTAMP

8. Question 8 · 1

   Which of the following describes label drift?

   Choose one answer.

   • Label drift is when there is a change in the distribution of the predicted target given by the model
   • None of these describe label drift
   • Label drift is when there is a change in the distribution of an input variable
   • Label drift is when there is a change in the relationship between input variables and target variables
   • Label drift is when there is a change in the distribution of a target variable

9. Question 9 · 1

   Which of the following machine learning model deployment paradigms is the most common for machine learning projects?

   Choose one answer.

   • On-device
   • Streaming
   • Real-time
   • Batch
   • None of these deployments

10. Question 10 · 1

    A data scientist would like to enable MLflow Autologging for all machine learning libraries used in a notebook. They want to ensure that MLflow Autologging is used no matter what version of the Databricks Runtime for Machine Learning is used to run the notebook and no matter what workspace-wide configurations are selected in the Admin Console. Which of the following lines of code can they use to accomplish this task?

    Choose one answer.

    • mlflow.sklearn.autolog()
    • mlflow.spark.autolog()
    • spark.conf.set(“autologging”, True)
    • It is not possible to automatically log MLflow runs.
    • mlflow.autolog()

11. Question 11 · 1

    A machine learning engineer is monitoring categorical input variables for a production machine learning application. The engineer believes that missing values are becoming more prevalent in more recent data for a particular value in one of the categorical input variables. Which of the following tools can the machine learning engineer use to assess their theory?

    Choose one answer.

    • Kolmogorov-Smirnov (KS) test
    • One-way Chi-squared Test
    • Two-way Chi-squared Test
    • Jenson-Shannon distance
    • None of these

12. Question 12 · 1

    A data scientist has developed a model model and computed the RMSE of the model on the test set. They have assigned this value to the variable rmse. They now want to manually store the RMSE value with the MLflow run. They write the following incomplete code block: Which of the following lines of code can be used to fill in the blank so the code block can successfully complete the task?

    Choose one answer.

    

    • log_artifact
    • log_model
    • log_metric
    • log_param
    • There is no way to store values like this.

13. Question 13 · 1

    Which of the following MLflow operations can be used to automatically calculate and log a Shapley feature importance plot?

    Choose one answer.

    • mlflow.shap.log_explanation
    • None of these operations can accomplish the task.
    • mlflow.shap
    • mlflow.log_figure
    • client.log_artifact

14. Question 14 · 1

    A machine learning engineering team wants to build a continuous pipeline for data preparation of a machine learning application. The team would like the data to be fully processed and made ready for inference in a series of equal-sized batches. Which of the following tools can be used to provide this type of continuous processing?

    Choose one answer.

    • Spark UDFs
    • Structured Streaming
    • MLflow
    • Delta Lake
    • AutoML

15. Question 15 · 1

    A machine learning engineer wants to deploy a model for real-time serving using MLflow Model Serving. For the model, the machine learning engineer currently has one model version in each of the stages in the MLflow Model Registry. The engineer wants to know which model versions can be queried once Model Serving is enabled for the model. Which of the following lists all of the MLflow Model Registry stages whose model versions are automatically deployed with Model Serving?

    Choose one answer.

    • Staging, Production, Archived
    • Production
    • None, Staging, Production, Archived
    • Staging, Production
    • None, Staging, Production

Paid access to all 39 questions

Each purchase applies to this certification. Prices are one-time payments, not monthly subscriptions.