Databricks Release Notes

Due to a bug, certain authorization and authentication audit logs include a port number in addition to the IP in the sourceIPAddress field (for example, "sourceIPAddress":"10.2.91.100:0"). The port number, which is logged as 0, does not provide any real value and is inconsistent with the rest of the Databricks audit logs. To enhance the consistency of audit logs, Databricks plans to change the format of the IP address for these audit log events. This change will gradually roll out starting in early August 2024.

If the audit log contains a sourceIpAddress of 0.0.0.0, Databricks might stop logging it.

• Benchmark execution bug fix in Genie: A bug where benchmarks would not execute immediately after creating a benchmark run has been fixed.

• Popular query suggestions in Genie: Genie will now suggest popular queries as example SQL for newly added tables to the space. Only popular queries that the author has access to are suggested. See Create a Genie Agent.

• Table metadata improvement in Genie: The process to provide table metadata to Genie has been changed to simplify data transformation for Genie workloads.

• Genie knowledge store: The knowledge store allows authors to build more reliable, accurate Genie Agents (formerly Genie Spaces). Authors can now annotate, edit, and manage Genie datasets at the space level using the following features:

  • Increased accuracy with format assistance: Genie now provides format assistance (previously example values) when you add tables to a space, helping it better understand the data in your tables and generate more accurate responses. See Edit column metadata.
  • Edit column descriptions in Genie: You can now edit table and column descriptions at the Genie-space level. This allows you to fine-tune metadata descriptions within a specific the Genie Agent (formerly Genie Space). See Edit column metadata. …

• Exclude selected values in filter widgets: Dashboard viewers can now include or exclude the values they select from multi-select filter widgets.

A point map visulization showing average number of bedrooms by price. A filter with multiple values selected excludes selected values from the chart.

• Drop-down selection fix: Fixed an issue where selection options in a drop-down list appeared out of order.

• Global filters panel: Dashboard authors can now add filters to a global filters panel, which applies across all dashboard pages.

• Relative date and time preview improvement: Previews for relative date and time controls are now hidden to avoid confusion caused by time zone differences.

• Dashboard PDF snapshots improvement: Dashboard PDF snapshots now wrap the content of the dashboard and no longer include white space.

• Constant reference line annotations: Horizontal and vertical constants reference line annotations for quantitative axes in cartesian chart types, such as area, bar, line, scatter, heatmap, and histogram charts.

• Usage guidance addition in Genie: You can now add Usage Guidance to clarify how and when SQL examples should be used.

Usage guidance text entry.

• Improved query result display in Genie: Query results now show more quickly. It now displays Running query until the query result is ready and Still thinking if additional work is required.

• UI polling update in Genie: The UI now starts polling for result data sooner rather than waiting until after the visualization and sample questions are generated.

• SQL function de-emphasis in Genie: The option to add SQL functions has been de-emphasized, making adding example SQL the default action.

• Improved result delivery timing in Genie: Descriptions are now generated after the SQL is run, thereby reducing the time it takes to get results.

• Fixed empty visualizations issue in Genie: Fixed an issue where empty visualizations were occasionally rendering in Genie.

• Genie in dashboards query update: Genie in dashboards will now only query from dashboard datasets, instead of the underlying tables within dashboard datasets.

• Custom calculation support in dashboards: Added support for custom calculations using isnull, isnotnull functions, and the null operator.

• AI/BI dashboard schedule support: AI/BI dashboard schedules now support dashboards without embedded credentials.

• Dashboard tooltip and number formatting fixes:

  • Tooltip fix: Fixed tooltips to display an empty value when the field value is an empty string ("").
  • Number formatting support: Number formatting in table and pivot table cells from notebooks, SQL editor, and legacy dashboards can now be carried over to AI/BI dashboards.

• Select and add multiple tables and views: Users can now select and add multiple tables and views at once from the Add data dialog.

• Draft dashboard scheduling bug fix: Fixed a bug that allowed draft dashboards to be scheduled using the API. Now, only published dashboards can be scheduled.

• AI-assisted point maps in dashboards: You can now use natural-language prompts to generate point map charts in dashboards.

• Deploy dashboard tasks using Declarative Automation Bundles: You can now use dashboard tasks within a job resource when deploying bundles. To learn more about Declarative Automation Bundles, see What are Declarative Automation Bundles?. To learn more about programmatically configuring a dashboard task in a job, see the Jobs API.

• Follow-up questions for text responses in Genie: Genie now suggests follow-up questions for text responses that include no generated SQL or results. Previously, follow-up questions appeared only after responses with a result set. Now, prompts such as Explain the data set also return suggested follow-up questions to help Genie Agent (formerly Genie Space) users explore the data.

Follow-up questions are suggested for a text-based response

• Improved instruction processing in Genie: Genie's chain-of-thought reasoning has been refined to prioritize and adhere to the most relevant instructions based on the user prompt.