News in 1.5.3

Platform changes:

  • Improved behavior of locked subflows:

    • Child nodes that have finished executing will give feedback immediately instead of after the whole locked flow has completed.

    • Child nodes that has executed successfully, in memory, will show up in purple color to indicate that their output port data is unavailable.

    • Output from locked child nodes will be shown like for other nodes, in the Messages view.

    • Modifying locked flows will no longer reload all nodes.

    • Showing progress from child nodes.

  • Locked subflows and lambdas (Apply, Map) will continue executing as much as possible instead of aborting after the first node has failed.

  • Subflow configuration wizard copes with nodes executed in locked subflows and executes them when needed to ensure that progress can be made.

  • Toggle-able filter for list parameters with mode selection saves vertical space.

  • Included brief description of current node state in tooltips.

  • Documentation improvements:

    • Links to example flows in the node documentation for many nodes, see Example flows.

    • Documented how to create custom library tags for third party libraries, see Library tags.

    • Documented how to create plugins for calculators, importer and exporter nodes, see Plugins.

    • Improved documentation for Tables with more modern APIs and descriptions of attributes etc.

  • Windows installer generates links and file associations that ignore local user site - this makes the bundled Python more stand-alone and helps avoid issues in case of package conflicts.

Figure and plotting updates:

  • Figure(s) can now take any sympathy object or lists of object instead of just tables. The configuration output table is now optional and need to be added explicitly to be used. Arguments can now be accessed using “arg” instead of “table” in expressions, eg. arg[‘X’] gives column X if the argument is a table.

  • Improved the Figure node with new plot types and drawing primitives:

    • Boxplots calculating and visualizing median, average, quantiles and outliers.

    • Pie-charts.

    • Timeline plots for drawing events or states.

    • Sets of unconnected lines based on starting/ending XY points.

    • Rectangles and Ellipses.

    • Text and arrows (annotations) to point out or label parts of data.

    • Images (using the generic Figure inputs).

  • Added extended example “Figure Gallery” with 12 plots to show how the new plot types and options can be used.

  • Added options for drawing error-bars on scatter-plots and bar-plots.

  • Frames and axes can now toggle visibility and the XY spines of the axes can be drawn at a predetermined XY data coordinate (eg. with the axis through origo), or at a given point on the screen (eg. center).

  • Fixed bug showing tooltips for plot parameters.

Node/plugin changes:

  • Added error strategies to Get Item List, when the list is empty.

  • Add different strategies for handling lists of different lengths in Zip Tuple.

  • Added median filtering to Overlay Images and Overlay Images List

  • Added Colormap lookup to explicitly create colors from values, useful when creating many figures where exact control of the colors are needed. New color-maps added for discrete categories of objects.

  • Fixed bug in Image to List missing one of the extracted objects.

  • Improved Generic Calculator with:

    • More robust handling of dependencies between calculations.

    • Compacted layout with a larger portion available for preview. Input signals are shown in in the tree where functions are shown.

    • Drag and drop of calculations.

    • Ability to set custom attributes for each calculation.

  • Error handling for Extract lambda nodes with choice between skip and error.

  • Match Tables Nodes: support for masked arrays.

  • Filter ADAFs: will only auto-refresh when it has been enabled.

  • Adaf(s) to Table(s): shows preview of available signals.

  • Many nodes have toggle-able filter for their column selection editors.

  • Dask visualize example: improved detection of Graphviz installation.

  • Ensure columns in Tables with Table: can create type-dependent zero elements for missing columns.

  • MDF importer plugin has better support for reading partially unsupported or broken files.

  • Avoid infinite loop when loading scikit-learn 0.20.

  • Excel importer plugin copes with date values outside of supported range by assigning masked values.

New nodes/plugins:

  • Rename datasource with Regex: helps to simplify automatically creating new datasource names based on existing file names.

  • ADAF importer plugin for LabVIEW TDMS files.

  • Transpose List swaps the outer two layers of a nested list.

  • Descriptive statistics: calculates simple descriptive statistics for all columns in a table.

API changes:

  • Generalized interface for import and export nodes and their plugins.

  • Opt-in support for toggle-able filter for single-select parameters with combo box editors.

  • Public APIs for creating importer and exporter plugins.

  • Datasource: added getitem. Example use: datasource['type'].

  • Table: added setter for name. Example use: table.name = 'some name'.

  • New exception: SyColumnTypeError, raised when creating table columns of unsupported type.

News in 1.5.2

Platform changes:

  • Fixed problem causing the OK button to be disabled (grey) when configuring subflows containing certain nodes (for example, Interpolate ADAF and Convert Specific Columns in Table using the Wizard or Tabbed dialog.

News in 1.5.1

Platform changes:

  • Improved performance overhead of nodes that simply select some columns of the incoming data and pass them to the output.

  • Significantly reduced file sizes of lambdas on disk.

  • More careful disconnection of signals to improve stability and performance.

  • Added option to Unlink linked subflows.

  • Confirmation dialog when canceling subflow configurations with unsaved changes.

  • Better feedback and handling of node errors when configuring subflows.

  • Improved ability to open (somewhat corrupt) flows with duplicate identifiers, instead of failing early.

  • Cleared up separation between flows linked from library and normal linked subflows.

  • Disabled automatic documentation generation.

  • Cleaned up command line options, “-” is used to separate words instead of “_”.

  • Added Recent libraries, to simplify switching between libraries in use.

  • Restructured documentation format for Nodes.

  • New installation instructions for Linux and Mac OS.

  • Saving warning filter between node executions to avoid interference.

  • Improved deprecation warnings for nodes, on by default.

  • Fixed some regressions causing library view not to update.

Node/plugin changes:

  • Improved feedback and validation for many scalar parameters. Incorrect values are displayed in red and the tooltip shows why.

  • Added progress and current list index, in case of error - to many list nodes.

  • In some cases, improved performance for Replace values in Table.

  • Improved documentation regarding handling of unmatched values for Lookup Table.

  • Select categories in ADAFs now respects the choice made in the combo box for raster selection.

  • Datasource nodes store UNIX paths in their configuration, but show paths in native format.

  • MDF Importer, improved performance when importing unsorted files and added option to attempt to read incomplete files without error.

  • ADAF exporter, improved GUI.

  • CSV exporter, improved performance.

  • ca.changed(), ca.changed_up(), and ca.changed_down() can now all handle masked arrays with scalar masks.

  • Filtered several expected warnings produced by nodes.

New nodes:

New flows:

News in 1.5.0

Sympathy for Data version 1.5.0 offers several improvements and new features, such as workflows in the library and routing points for connections.

Nodes and flows from 1.3 and 1.4 should for the most part be compatible with 1.5.0.

Platform changes:

  • Markdown is now supported in text fields.

  • Mark unavailable items in list views.

  • list views and combobox views can be edited when customized with editor attribute edit=True. This makes it possible to create selections that includes columns that do not exist in the input data or without executing previous nodes.

  • Shorter tab labels for flows, only showing parent flow names as necessary.

  • Only nodes that are in the current libraries can be used. Current libraries depend on the configured libraries for the current flow and the global selection from preferences.

  • Allow subflows to specify custom svg icons.

  • Route points for connections, see Route points.

  • 0 based indexing is used more consistently, that is, 0 is the index of the first element, etc. This behavior is more consistent with python code.

  • English/US locale is used regardless of the host language settings.

  • Generalized text-output port on all nodes.

  • Flows can be added to library, see Subflows in the Node Library.

API changes:

  • Improved backwards compatibility of ParameterLists during execution.

  • ParameterLists return copies of its internal state disallowing direct mutation.

  • Ability to get and set dask arrays in adaf and table APIs. See example nodes: Dask max example, Dask stack example and Dask tail example.

  • Made getitem, setitem usable as a shorthand way of working with arrays columns in tables. For example table1[‘x’] = table2[‘y’].

Node/plugin changes:

New nodes:

New flows:

Removed nodes: