Hi Zhang, another question, did you deploy your Azure Databricks and Machine Learning Service in different resource groups? If so, that went wrong.

I just created an additional parameter databricks_grp in project/services/10_prepEnvModelCreation.py to fix this such different resource groups can be used.

You need to delete your Azure Databricks compute in Machine Learning Service Workspace, add the new file project/services/10_prepEnvModelCreation.py to your project, fill in parameter databricks_grp and then rerun the pipeline. Let me know.

Data Solution Architect @ Microsoft, working with Azure services as ADFv2, ADLSgen2, Azure DevOps, Databricks, Function Apps and SQL. Opinions here are mine.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store