DataSpell 2023.2

Polars Support

• Interactive tables - Introduced interactive tables for Polars DataFrames, allowing you to sort, export, and view data effortlessly. These tables are supported both in Jupyter notebooks and in Python consoles. You can conveniently access the tables using the Python and Jupyter debuggers, variable viewers, and Data Vision.
• Column-name completion - Introduced column-name completion for supported Polars functions. This feature simplifies your interactions with the library and facilitates data manipulation within DataSpell.

Faster Table Data Exploration

• The data exploration process has been streamlined, which is crucial and often time-consuming for data professionals. By simply hovering over a column's header, you can now access valuable information about it, such as the value distribution, mean, and standard deviation, as well as missing values. This feature is currently available for pandas and Polars DataFrames.

New UI Improvements

• Colored project headers in the new UI - This release introduces colored headers to simplify navigation between multiple open projects. You can now assign a unique color and icon to each of your projects, making them easier to distinguish in your workspace. Headers now come with predefined colors by default, but you can customize them.
• Single-click navigation between project directories - In the Project view, there's a new Open Directories with Single Click option that makes expanding and collapsing the project folders quicker and more responsive.

Jupyter-managed server configuration support

• This release allows you to configure Jupyter-managed servers, providing you with, among other things, the ability to:
  • Specify environment variables for managed servers.
  • Configure managed servers to launch from any directory, not just the project root.
  • Specify additional parameters for Jupyter or the JupyterLab servers.

Improved synchronization of Jupyter notebooks with external applications

• In this release, how Jupyter notebook changes are synchronized between DataSpell and external applications such as Git or the browser version of Jupyter has been significantly improved. You can effortlessly switch between DataSpell and external applications, and any changes you make in either place will be synchronized.

Data Management

• Big Data Tools plugin - The Big Data Tools plugin has been decomposed, allowing you to use its parts separately. This means six new plugins are available for DataSpell: Kafka, Spark, Flink, Remote File Systems, Big Data File Viewer, and Zeppelin. If you need all six, installing the umbrella Big Data Tools plugin is still possible and a convenient way to get them all in one click.
• Support for Redis Cluster [Databases plugin] - You can now connect to Redis Cluster and enjoy the same comprehensive feature set as with standalone Redis.
• Time zone setting for the data editor [Databases plugin] - DataSpell now offers a new Time zone setting, allowing you to specify which time zone should be used for displaying datetime values.
• Support for external databases and datashares [Databases plugin] [Redshift] - Shared databases and their contents are now introspected. The datashares that these databases are created on are also introspected. You can modify shared databases and datashares using the Ctrl/Cmd + F6 shortcut. All related statements are now supported in the SQL editor.
• New UI for the schema migration dialog [Databases plugin] - The schema migration functionality has been significantly improved. The major change is that the same object is now placed on the same line in both parts of the dialog, making it easier to understand which objects will be added, removed, or modified in the target schema.