Running CrewAI with Databricks-Hosted LLMs
How to run CrewAI multi-agent workflows on Databricks using hosted foundation models instead of OpenAI, with LiteLLM and MLflow tracing.
CrewAIDatabricksLLM
About me
Personally, I'm interested in artificial intelligence, cooking, photography, dogs, spirituality and automobiles, in no particular order.
Professionally, I have a proven track record in data science leadership, bringing extensive experience driving impactful solutions across various industries. I've led teams in developing AI-powered applications that have yielded significant results. I'm passionate about fostering knowledge sharing and effective communication of complex data science concepts.
Latest Notes
View allSemi-structured Data Processing in Databricks
Explore two approaches for handling semi-structured data formats like JSON, XML, and CSV in Databricks - VARIANT data type and Spark Declarative Pipelines.
DatabricksData EngineeringApache Spark
Can Large Language Models Reason and Plan?
A critical examination of the planning and reasoning capabilities of LLMs, highlighting limitations in autonomous reasoning.
LLMPlanningReasoning