Databricks Agents
- Databricks Agents Python API
- Agent Framework
- Lakehouse Monitoring for GenAI
create_external_monitor()delete_external_monitor()get_external_monitor()update_external_monitor()create_monitor()delete_monitor()get_monitor()update_monitor()AssessmentsSuiteConfigCustomMetricGuidelinesJudgeBuiltinJudgeMonitorMonitoringConfigMonitoringConfig.sampleMonitoringConfig.metricsMonitoringConfig.pausedMonitoringConfig.global_guidelinesMonitoringConfig.from_assessments_suite_config()MonitoringConfig.to_assessments_suite_config()MonitoringConfig.from_dict()MonitoringConfig.from_json()MonitoringConfig.schema()MonitoringConfig.to_dict()MonitoringConfig.to_json()
SchedulePauseStatus
- Agent Evaluation
generate_evals_df()estimate_synthetic_num_evals()metric()ToolCallInvocation- Judges
- Datasets
create_dataset()DatasetDataset.dataset_idDataset.digestDataset.nameDataset.schema()Dataset.profileDataset.sourceDataset.source_typeDataset.create_timeDataset.created_byDataset.last_update_timeDataset.last_updated_byDataset.set_profile()Dataset.insert()Dataset.merge_records()Dataset.to_df()Dataset.from_dict()Dataset.from_json()Dataset.to_dict()Dataset.to_json()
delete_dataset()get_dataset()
- Review App
Agentget_review_app()LabelingSessionLabelingSession.nameLabelingSession.assigned_usersLabelingSession.agentLabelingSession.label_schemasLabelingSession.labeling_session_idLabelingSession.mlflow_run_idLabelingSession.review_app_idLabelingSession.experiment_idLabelingSession.urlLabelingSession.enable_multi_turn_chatLabelingSession.custom_inputsLabelingSession.add_dataset()LabelingSession.add_traces()LabelingSession.sync_expectations()LabelingSession.set_assigned_users()LabelingSession.from_dict()LabelingSession.from_json()LabelingSession.schema()LabelingSession.to_dict()LabelingSession.to_json()
ReviewAppReviewApp.review_app_idReviewApp.experiment_idReviewApp.urlReviewApp.agentsReviewApp.label_schemasReviewApp.review_app_idReviewApp.experiment_idReviewApp.urlReviewApp.agentsReviewApp.label_schemasReviewApp.add_agent()ReviewApp.remove_agent()ReviewApp.create_label_schema()ReviewApp.delete_label_schema()ReviewApp.create_labeling_session()ReviewApp.get_labeling_sessions()ReviewApp.delete_labeling_session()ReviewApp.from_dict()ReviewApp.from_json()ReviewApp.schema()ReviewApp.to_dict()ReviewApp.to_json()
- Label Schemas