Graviti Help Center
Search…
⌃K

Release Note

To help you keep track of the ongoing updates and improvements to Graviti products, we publish release notes that describe recent changes.

2022-03-30

Graviti Data Platform Improvements:
  • Added Records on the Activity page to list the new datasets that were forked or created by Filter.
  • Optimized users’ login process.

2022-03-10

Graviti Data Platform New Feature:
  • Added compute management function. The compute consumed by Offline Filter, Cross-version comparison, Action, Sextant Model Evaluation and Squash&Merge will be automatically calculated and the results will be displayed on the dashboard page and Your Asset page for viewing and management.
Graviti Data Platform Improvements:
  • Optimized the Version Control function. Simplify users’ operation process by putting all the functions of Version Control on a single management page.

2022-02-15

Graviti Data Platform Improvements:
  • Fixed bugs on data capacity statistics.
  • Optimized the login UI of Graviti data platform.
  • Added Crontab drop-down box component in the scheduled trigger. Optimized the input box to support special characters “?” “\”.

2022-01-24

Graviti Data Platform New Features:
  • Added scheduled trigger in Action. Users can make workflows run on schedule.
  • Added Activity Registration on the Website Home Page. Users can enter the Event Detail page for more information, registration and documents downloading.
Graviti Data Platform Improvements:
  • Optimized features of the Data Dashboard. Users can view monthly Used Data Volume on the Details page.
  • Optimized the copywriting of Sextant, changing Evaluation to Benchmark.
  • Added Select All option on the Delete Data page to help users quickly delete the data.
  • Added the ISO9001 certification icon and modified relative copywriting on the Data Hosting page.
  • Optimized the User Interface of GroundTruth on the Select Dataset page. Added details of the Commit, including Type, Amount, Creator and Updated Time, to help users quickly choose datasets. Added Paging function to improve the user experience.
Python SDK New Features:
  • Add open dataset loaders VGGFace2
Python SDK Bug Fix:
  • Fix reading cached file failed in a multiprocess environment
  • Fix the Job.started_at will not be updated
  • Fix the ValueError when init PointList2D and RLE with Numpy array
  • Fix the NoneType error in Job.update
Python SDK Improvements:
  • Remove the multiprocess lock and add PID to cached file path
​

2021-12-30

Graviti Data Platform New Feature:
  • Optimized the cross-version comparison function. Graviti Data Platform now supports cross-version comparison by selecting the corresponding commit by branch and tag.
Python SDK New Features:
  • Implement the async job framework
    • Implement JobMixin._create_job
    • Implement JobMixin._get_job
    • Implement Job.updat
    • Implement JobMixin.delete_job
    • Implement Job.retry and Job.abort
    • Implement JobMixin._list_job
  • Implement SquashAndMerge feature by async job framework
    • Implement SquashAndMerge.create_job
    • Implement SquashAndMerge.delete_job
    • Implement SquashAndMerge.get_job
    • Implement SquashAndMerge.list_jo
    • Implement SquashAndMergeJob.result
  • Add the following open dataset loader:
    • CityscapesGTFine
    • CityscapesGTCoarse
    • RarePlanesRea
    • RarePlanesSynthetic
    • UrbanObjectDetection
Python SDK Improvements:
  • Getting mask URLs from OpenAPI getDataDetails to reduce the number of requests
Python SDK Documentation:
  • Update the docs about "Squash And Merge" in "Features"
  • Refine the docs
  • Refine the docstring
Python SDK Documentation:
  • Change the Sphinx Html theme to "furo"
  • Change the Sphinx Html theme to "furo"

2021-12-17

Python SDK Bug Fix:
  • Fix RemoteFileMixin._urlopen() failed when URL is expired

2021-12-16

Graviti Data Platform New Feature:
  • Added secrets in Action. Users can configure their secrets in the settings of Action. The secrets that users configure are available to use in Action Yaml files. (only available for administrators)
Python SDK New Features:
  • Add interfaces to communicate with Sextant Apps
    • Implement Sextant.list_benchmarks
    • Implement Sextant.list_evaluations
    • Implement Sextant.create_evaluations
    • Implement Evaluation.get_result
  • Add SemanticMask for BDD100K_MOTS2020 dataset
  • Add author, updated_at and parent_commit_id for Draft
  • Add --show-drafts for CLI gas log to support displaying open drafts
Python SDK Improvements:
  • Remove the redundant attributes in BDD100K dataset
  • Update VersionControlClient to VersionControlMixin
  • Use stem to represent the filename without extension in opendataset module
Python SDK Bug Fixes:
  • Add the missing categoryDelimiter to the OxfordIIITPet catalog
  • Fix NoneType not subscriptable error in listMaskUrls
  • Fix the AttributeError when calling the mocker class methods
  • Correct the wrong attribute names in nuImages catalog
​
  • Add "PaddlePaddle" instructions in INTEGRATIONS chapter
  • Add documentation for Sextant in Applications chapter
  • Reconstruct Storage Config in Advanced Features chapter
  • Support deleting automatically generated rst files via make clean
  • Refine the docstring

2021-12-07

Python SDK Bug Fixes:
  • Fix the request timeout issue when reading data in multiprocess environment
  • Fix the TypeError caused by positional arguments mismatch when using Profile

2021-12-03

Graviti Data Platform New Features:
  • Add a data dashboard to enable users to view the data storage capacity of each workspace and used data volume
  • Add an email subscription portal for users to get our latest updates
Graviti Data Platform Improvements:
  • Optimize the creation steps of datasets and user interactive experience
  • Optimize the functions of Action. Add a manual option, YAML code templates, and a stop workflow button (this function is only available to the team admin)
Python SDK New Features:
  • Add --sort option for CLI gas branch and gas tag to support sorting branches and tags
  • Support recording statistical info for Data.open().read() in Profile class
  • Add StorageConfig class to store storage config info
  • Add SegmentClient.get_data to get data info by its remote_path
  • Support showing a piece of data via remote_path in CLI gas ls
Python SDK Improvements:
  • add URL class for getting and updating the file URL
  • Add train, val and test in segment name in DAVIS2017
Python SDK Bug Fixes:
  • Fix the wrong graph in CLI gas log when merging branches
  • Add the missing categoryDelimiter in COCO2017 catalog
  • Fix the FileExistsError when using cache with multiprocess
Python SDK Documentation:
  • Use autosummary to generate rst files in opendataset module under "API" chapter
  • Refine the docs
  • Refine the docstring

2021-12-01

Python SDK Improvement:
  • Make timeout setting in tensorbay.client.config take effect for urlopen

2021-11-17

Graviti Data Platform Improvements:
  • Optimize the interface and interactivity of the Apps market
  • Optimize the display of the data dashboard
Python SDK New Features:
  • Add checking and warning for free storage space when enabling cache
  • Add the following open dataset loaders:
    • SCUT_FBP5500
    • DAVIS2017
Python SDK Improvements:
  • Add argument encoding='utf-8' to open() to make it compatible for Windows
  • Use xmltodict to parse xml files instead of xml.ElementTree
  • Add file tensorbay/py.typed to comply with PEP-561
Python SDK Bug Fix:
  • Fix Data.open catch exception failed when url is expired
Python SDK Documentation:
  • Reconstruct "Version Control" chapter
  • Fix the typo in the docs
  • Refine the docs
  • Refine the docstring
Python SDK Deprecation:
  • Remove the deprecated method GAS.create_auth_dataset

2021-11-02

TensorBay Bug Fix:
  • Fix some bugs to optimize the user experience
Sextant Improvement:
  • Add the Retry button to allow a dataset to be evaluated again after failing
Python SDK New Features:
  • Support setting is_public in GAS.create_dataset
  • Support importing authorized cloud files to fusion dataset
  • Support cache when opening remote data
  • Add DatasetClientBase.get_total_size to get the total data size in a dataset commit
  • Add VersionControlClient.squash_and_merge to merge two different branches
Python SDK Improvements:
  • Use os.path.expanduser to handle the CLI config file path in different systems
  • Replace relative import with absolute import for all python files in SDK
  • Remove the useless checks about commits and drafts in ls.py
  • Add X-Request-Id to all the TensorBay OpenAPI request headers
  • Add a detailed resuming message when uploading process got interrupted in CLI gas cp
Python SDK Bug Fixes:
  • Add a workaround for the IndexError when loading the data with panoptic mask
  • Remove the wrong error message in gas dataset when tbrn is absent
Python SDK Documentation:
  • Add docs about the data cache
  • Add docs for using pharos on remote server
  • Refine the docs

2021-10-18

Python SDK New Features:
  • Display elapsed time of the request in the debug log
  • Use response.elapsed to get the cost time of a request in profile
  • Add DatasetClientBase.get_label_statistics to get the label statistics info
  • Support updating file urls when the urls are expired
  • Add open dataset loaders SegTrack2
Python SDK Improvements:
  • Consolidate all config-related functions in ContextInfo
Python SDK Performances:
  • Adapt OpenAPI getDataDetails to increase the speed of reading labels and URLs
  • Upload auth cloud storage data labels on the cloud-callback OpenAPI to increase the uploading speed
Python SDK Documentation:
  • Add "Update Dataset Notes" section in "Update Dataset" chapter
  • Add docs about cloud file in-place importing in "Cloud Storage"
  • Add docs about getting the label statistics info in "Get Label Statistics"
  • Refactor the "Version Control" chapter
  • Refine the docs

2021-09-28

TensorBay Enhanced Features：
  • Add discussion function on the public dataset details page in the mobile terminal
  • Optimize the interaction of data list search
  • Divide Apps into different types according to their attributes on the Apps Market page
Python SDK New Features:
  • Support filtering drafts by status and branch_name inVersionControlClient.list_drafts
  • Add class Profile to record the statistical information about the HTTP requests in SDK
    • Support using Profile in the multi-process environment
    • Support saving Profile summary to csv, txt or json file
  • Add the following BDD100K related open dataset loaders
    • BDD100K
    • BDD100K-10K
    • BDD100K-MOT
    • BDD100K-MOTS
  • Add the following open dataset loaders:
    • SegTrack
    • COCO2017
  • Unify the format of prompt messages in CLI
Python SDK Bug fixes:
  • Fix the dataset loader LIP and CIHP cannot be imported from opendataset module
  • Correct the wrong visible status in LIP dataset loader
Python SDK Improvements:
  • Unify the variable names about directory and tbrn
  • Use ValueError, StatusError to replace OperationError
Python SDK Documentation:
  • Add examples about SemanticMask and InstanceMask
  • Add catalog structure for different label types
  • Add docs about how to use Profile
  • Fix the typos in docs
  • Refine the docs
Python SDK Deprecations:
  • Remove the deprecated class ResponseSystemError

2021-09-14

Sextant New features:
  • Support customized metrics by uploading Github Repo Url into Sextant
  • Add more data types that can be evaluated
TensorBay Enhanced Feature：
  • Support creating new datasets by merging datasets via Python SDK
Python SDK New Features:
  • Support creating a dataset with different cloud storage configs inGAS.create_dataset
  • Add the following methods to create customized cloud storage configs for different cloud services:
    • GAS.create_oss_storage_config
    • GAS.create_s3_storage_config
    • GAS.create_azure_storage_config
  • Add GAS.delete_storage_config to delete customized cloud storage config
  • Enable the method SegmentClient.delete_data to delete data
  • Add FusionSegmentClient.delete_frame to delete frame
  • Support getting and updating dataset isPublic flag
  • Add the following open dataset loaders:
    • CIHP
    • VOC2012Segmentation
    • PASCALContext
    • LIP
    • OxfordIIITPet
    • nuImages
  • Print more friendly error messages in CLI
Python SDK Interface Adjustments:
  • Set current revision as the default in VersionControlClient.list_commits
  • Disable method FusionSegmentClient.delete_data to stop deleting data in Fusion dataset
Python SDK Improvements:
  • Prohibit closing current draft in VersionControlClient.close_draft
  • Avoid getting done_frames when skip_upload_files is False in FusionDatasetClient.upload_segment
Python SDK Documentation:
  • Add docs about "Update Dataset Meta"
  • Add docs about "Delete Frame"
  • Fix the typos in docs
  • Refine the docs
Python SDK Deprecations:
  • Remove the deprecated code before v1.10.0
  • Deprecate GAS.create_auth_dataset and use GAS.create_dataset instead

2021-08-30

TeraGood New Feature：
  • Support editing labels of the fusion dataset in TeraGood
TensorBay Enhanced Feature:
The data list is optimized from a one-dimensional list to a two-dimensional list. Users can view more details of the data list via subtables. Support users to switch versions, view information, search, view catalog, show diff and do other operations on the data list page.
Python SDK New Feature:
  • Support new label types: SemanticMask, InstanceMask and PanopticMask
Python SDK Interface Adjustments:
  • Remove the loads method for DataBase, Data and AuthData
  • Add get_callback_body method to replace dumps in Data
  • Add from_response_body method to replace loads in RemoteData & Frame
Python SDK Bug Fixes:
  • Add a workaround for MalformedPOSTRequest error when posting files to Aliyun OSS
Python SDK Improvements:
  • Add FileMixin and RemoteFileMixin for file-related methods
  • Support setting custom loader and dumper in AttrsMixin
Python SDK Documentation:
  • Add docs about SemanticMask, InstanceMask and PanopticMask

2021-08-17

New Features:
  • Data storage configuration supports developers to choose different regions and team members to choose different cloud platforms or regions as the default storage configuration.
  • Add data usage statistics function. Users can view the used data volume on the GAS homepage and the assets page.
  • Support data synchronization within GroundTruth Tools. GroundTruth Tools support the 2d/3d fusion labeling tools and can synchronize the labeling data to Tensorbay.
  • Support booking demo on the GAS home page.
Enhanced Feature:
  • Support to select, modify server configuration and record parameters in Action.
Python SDK New Features:
  • Support new label types Polygon and Polyline2D, add five label formats:
    • Polygon + MultiPolygon + RLE
    • Polyline2D + MultiPolyline2D
  • Add the following open dataset loaders:
    • VOC2012Detection
    • VOC2012ActionClassification
    • CCPD & CCPDGreen
  • Add name conflict check for SortedNameList
  • Support setting network request config (is_internal, max_retries, and timeout) in CLI gas config
  • Support to validate the AccessKey and display the user info in CLI gas auth
  • Add --status option for CLI gas auth to display the user and auth info
  • Support displaying error messages for CLI gas auth
  • Add -l option for CLI gas ls to show the total number of resources
  • Add --all option for CLI gas log to show the commits in all branches
  • Add --graph option for CLI gas log to show the graphical commits
  • Set -h as an abbreviation of --help to show CLI help messages
Python SDK Interface Adjustments:
  • Remove the path argument in GAS.create_auth_dataset because the path is bound to the cloud storage config
Python SDK Bug Fixes:
  • Add a workaround for the issue Chinese characters display garbled in the Windows system
Python SDK Improvements:
  • Use list comprehension in PointList2D.__init__ instead of for-loop
  • Set None as the default value of the argument alias in GAS.update_dataset
  • Correct the illegal remote paths for RP2K dataset loader
  • Encapsulate the moving segment logic into DatasetClientBase._move_segment
  • Move the deprecation related classes into deprecated.py
  • Stop showing the redundant field name in AttributeInfo .__repr__
  • Cleanup the following useless codes:
    • Remove the useless class variable _label_attrs from label related classes
    • Remove the useless class SubcatalogTypeRegister
    • Remove the useless class LabelType
    • Remove the useless type Subcatalogs
Python SDK Documentation:
  • Add docs about "Shell Completion" in the "CLI" section
  • Add docs about new label formats Polygon and Polyline2D
  • Add docs about setting network request config in CLI gas config
  • Add docs about --all and --graph options in CLI gas log
  • Fix the typo in docs
  • Refine the docs

2021-08-04

New Features:
  • Add model evaluation tools Sextant. Sextant supports quick evaluation of data and models, enabling you to gain insight into data quality and model accuracy, and providing references for data quality improvement.
  • Add advanced search. Users can upload Github URL to get the corresponding file and set the file as a filter.
  • Support modifying and conducting quality assurance of labels of 2D Box and 2D Polygon in TeraGood and GroundTruth.
Enhanced Feature:
  • Optimize data search. Data search is performed offline now. Users can view the search progress and results and save search results for creating new datasets and so on.
Python SDK New Features:
  • Support override and skip strategies in SegmentClient.move_data
  • Add GAS.get_user to get the current user info
  • Support manipulating dataset alias:
    • Support getting the dataset alias in GAS.get_dataset
    • Support setting the dataset alias in GAS.create_dataset
    • Add GAS.update_dataset to update the dataset alias
  • Support setting and showing description in CLI gas draft
  • Add --edit option in CLI gas draft to edit a draft
  • Add --close option in CLI gas draft to close a draft
  • Add draft description to the pop-up editor of gas commit as default message
  • Display the corresponding message after deleting data or a segment in gas rm
Python SDK Interface Adjustments:
  • Change the signature of Transform3D.set_rotation and Sensor.set_rotation
Python SDK Improvements:
  • Unify the description display logic in gas draft and gas commit
  • Set the file name as "" when posting files to cloud storage
  • Add utility function chunked to break an iterable into length n tuples
  • Set the minimum version of urllib3 back to v1.15
Python SDK Performance:
  • Speed up file uploads for fusion dataset in GAS.upload_dataset by adapting OpenAPI multiCallback
  • Speed up file uploads by sending file size to TensorBay
  • Speed up file uploads by enlarging the batch size of multiCallback
Python SDK Documentation:
  • Add the docs about --edit and --close option in CLI gas draft
  • Add the docs about CLI "Profile"
  • Refine the docs
  • Fix the typo in docstrings
Python SDK Deprecations:
  • Remove the default value of the argument title in VersionControlClient.create_draft
  • Remove the deprecated message about setting AccessKey in gas config

2021-07-16

Python SDK bug fixes:
  • Fix CLI gas log --oneline that displays all commits in oneline
Python SDK Documentation:
  • Replace -t with -m in the docs of CLI gas draft
  • Add details about strategy in the docs of copy and move operations
  • Fix the Synopsis section display error in CLI gas commit --help
  • Use batch move in the example code of moving data instead of one by one

2021-07-14

New Features:
  • Diff to compare data of different versions, view the difference between draft and parent commit, or between commit and parent commit, and visualize the corresponding data and tag distribution.
  • Add or edit multiple tags for each data version, making it easy and fast to retrieve and manage.
Enhanced Feature:
  • Teragood supports modifying existing annotated data and performing quality assurance on the data.
Python SDK New Features:
  • Add Data.get_url to get the file:// url for a local file
  • Support more operations on draft:
    • Add status and description to the Draft class
    • Add VersionControlClient.update_draft to update title and description of a draft
    • Add VersionControlClient.close_draft to close a draft
    • Support setting description in VesionControlClient.create_draft
  • Add --message option in CLI gas draft to set title and description of a draft
  • Add SegmentClient.list_urls and FusionSegmentClient.list_urls to list the file urls
  • Add the following open dataset loaders:
    • UAVDT
    • CACD
    • AADB
    • COVID_CT
Python SDK Bug fixes:
  • Fix the ImportError when import tensorbay in python 3.6
Python SDK Improvements:
  • Add shorten function to get the short commit ID
  • Merge the CLASSIFICATION label into BOX2D label in the CompCars open dataset
  • Remove useless DatasetClient.import_all_files interface
  • Correct the illegal segment names in all the open dataset loaders
  • Move customized click classes from cli/cli.py to cli/custom.py
  • Stop showing the description in Commit.__repr__
  • Exclude useless docs and tests modules from the tensorbay package
Python SDK Performance:
  • Speed up file uploads in GAS.upload_dataset by adapting OpenAPI multiCallback
  • Enhance the performance of RemoteData.open by batch requesting file urls
Python SDK Documentation:
  • Add Synopsis section to CLI --help message
  • Refine the CLI docs
Python SDK Deprecations:
  • Deprecate the --title option in CLI gas draft
  • Remove the deprecated CLI gas create and gas delete
  • Remove the deprecated exception CommitStatusError

2021-06-22

New Features:
  • Version control of datasets based on branches.
  • Manage and edit datasets collaboratively with draft.
  • Add operation guide on the visualization widgets Pharos.
  • Developers edition users can now manage members and share "Viewer" permission for private datasets.
Enhanced Features:
  • Optimized the performance and operation of dataset version control.
  • Optimized the interface and UI elements of the Dashboard User Guide.

2021-06-03

Python SDK Bug Fixes:
  • Fix the AttributeError when using DatasetBase.keys() to list segment names

2021-05-31

New Feature:
  • Pharos visualization widgets can display JSON text files.
Enhanced Feature:
  • Optimized the multi-level data interface in the list mode of the label distribution visualization widgets, and now you can directly view the distribution of sub-level data in the overall data.
​
Python SDK New Features:
  • Redesign and implement the gas CLI based on TensorBay version control :
    • Support draft number and revision in TBRN
    • Add gas dataset command to create, list and delete dataset
    • Support gas ls command to list segments and data in specific draft or revision
    • Add gas draft command to create and list drafts
    • Add gas commit command to commit draft
    • Add gas cp command to upload files to draft
    • Add gas rm command to remove segment and data in draft
  • Add detailed resuming message when uploading process got interrupted
  • Add ModuleImportError to print detailed install instruction when the optional requirement package is not installed
  • Implement DatasetBase.__delitem__ to support delete segment from dataset by del
  • Add open dataset loader LISA Traffic Sign
Python SDK Bug fixes:
  • Fix the ValueError when passing the last item to UserSequence.index
Python SDK Improvements:
  • Remove the redundant class variable description in KeypointsInfo
  • Implement python attr framework AttrsMixin
  • Move TBRN from utility module to cli module
  • Inherit EqMixin to replace __eq__ in following intrinsic classes :
    • CameraMatrix
    • DistortionCoefficients
    • CameraIntrinsics
Python SDK Documentation:
  • Refactor CLI related docs
  • Add Integrations chapter for PyTorch and TensorFlow integration
  • Refine the docs
  • Fix the typo in docs
Python SDK Deprecations:
  • Deprecate CLI gas create and gas delete
  • Deprecate legacy fusion dataset TBRN
  • Remove the following deprecated interfaces :
    • Following exceptions：
      • GASDatasetError
      • GASDatasetTypeError
      • GASException
      • GASPathError
      • GASResponseError
      • GASSegmentError
    • The start and stop keyword arguments in following methods:
      • GAS.list_dataset_names
      • DatasetClientBase.list_drafts
      • DatasetClientBase.list_commits
      • DatasetClientBase.list_tags
      • DatasetClientBase.list_branches
      • DatasetClientBase.list_segment_names
      • SegmentClient.list_data_paths
      • SegmentClient.list_data
      • FusionSegmentClient.list_frames
    • Following methods：
      • DatasetClientBase.list_draft_titles_and_numbers

2021-05-17

New Features:
  • You can use developer tools to access the Pharos visualization widget to visualize local data. For details, please refer to the document.
  • Launched the dataset discussion function. Discussions can be posted for all the open datasets with @ and Like functions being added. You can @ dataset publishers or other relevant users to invite them to join the discussion and give your Likes to excellent content.
  • Released a new version of the dashboard and added the user guide to help users quickly understand the features of TensorBay and the way to access them.
  • Actions: You can monitor changes in datasets by creating a workflow, and automatically trigger a pre-defined data processing program to quickly build an automated data processing procedure (in internal testing).
Enhanced Features:
  • Optimized the UI design and interface of the label distribution visualization widgets.
  • Optimized the interaction of the Pharos visualization widgets on the data filters page, and you can directly view the annotation types in the filters by default.
​
Python SDK New Features:
Python SDK Bug fixes:
  • Fix the JSONDecodeError occurred when uploading dataset
  • Fix the AttributeError when using CADC dataloader in python3.6
  • Fix the AttributeError when resuming upload of fusion dataset
Python SDK Documentation:
  • Add docs for local visualization plugin pharos