2021-06-03

Python SDK Bug fixes:

• Fix the AttributeError when using DatasetBase.keys() to list segment names

2021-05-31

New Feature:

• Pharos visualization widgets can display JSON text files.

Enhanced Feature:

• Optimized the multi-level data interface in the list mode of the label distribution visualization widgets, and now you can directly view the distribution of sub-level data in the overall data.

Python SDK New Features:

• Redesign and implement the gas CLI based on TensorBay version control :

  • Support draft number and revision in TBRN

  • Add gas dataset command to create, list and delete dataset

  • Support gas ls command to list segments and data in specific draft or revision

  • Add gas draft command to create and list drafts

  • Add gas commit command to commit draft

  • Add gas cp command to upload files to draft

  • Add gas rm command to remove segment and data in draft

• Add detailed resuming message when uploading process got interrupted

• Add ModuleImportError to print detailed install instruction when the optional requirement package is not installed

• Implement DatasetBase.__delitem__ to support delete segment from dataset by del

• Add open dataset loader LISA Traffic Sign

Python SDK Bug fixes:

• Fix the ValueError when passing the last item to UserSequence.index

Python SDK Improvements:

• Remove the redundant class variable description in KeypointsInfo

• Implement python attr framework AttrsMixin

• Move TBRN from utility module to cli module

• Inherit EqMixin to replace __eq__ in following intrinsic classes :

  • CameraMatrix

  • DistortionCoefficients

  • CameraIntrinsics

Python SDK Documentation:

• Refactor CLI related docs

• Add Integrations chapter for PyTorch and TensorFlow integration

• Refine the docs

• Fix the typo in docs

Python SDK Deprecations:

• Deprecate CLI gas create and gas delete

• Deprecate legacy fusion dataset TBRN

• Remove the following deprecated interfaces :

  • Following exceptions：

    • GASDatasetError

    • GASDatasetTypeError

    • GASException

    • GASPathError

    • GASResponseError

    • GASSegmentError

  • The start and stop keyword arguments in following methods:

    • GAS.list_dataset_names

    • DatasetClientBase.list_drafts

    • DatasetClientBase.list_commits

    • DatasetClientBase.list_tags

    • DatasetClientBase.list_branches

    • DatasetClientBase.list_segment_names

    • SegmentClient.list_data_paths

    • SegmentClient.list_data

    • FusionSegmentClient.list_frames

  • Following methods：

    • DatasetClientBase.list_draft_titles_and_numbers

2021-05-17

New Features:

• You can use developer tools to access the Pharos visualization widget to visualize local data. For details, please refer to the document.

• Launched the dataset discussion function. Discussions can be posted for all the open datasets with @ and Like functions being added. You can @ dataset publishers or other relevant users to invite them to join the discussion and give your Likes to excellent content.

• Released a new version of the dashboard and added the user guide to help users quickly understand the features of TensorBay and the way to access them.

• Actions: You can monitor changes in datasets by creating a workflow, and automatically trigger a pre-defined data processing program to quickly build an automated data processing procedure (in internal testing).

Enhanced Features:

• Optimized the UI design and interface of the label distribution visualization widgets.

• Optimized the interaction of the Pharos visualization widgets on the data filters page, and you can directly view the annotation types in the filters by default.

​

Python SDK New Features:

• The local visualization plugin pharos is released, it can be installed by pip3 install pharos:

  • Pypi: https://pypi.org/project/pharos/​

  • Docs: https://tensorbay-python-sdk.graviti.com/en/v1.4.1/features/visualization.html​

Python SDK Bug fixes:

• Fix the JSONDecodeError occurred when uploading dataset

• Fix the AttributeError when using CADC dataloader in python3.6

• Fix the AttributeError when resuming upload of fusion dataset

Python SDK Documentation:

• Add docs for local visualization plugin pharos

2021-05-15

Python SDK New Features:

• Make PagingList mutable, and follow MutableSequence protocol

• Support reading remote data lazily in Dataset and Segment:

  • Lazy evaluation in Segment

  • Lazy evaluation in Dataset

• Support getting segment by name in DatasetBase.__getitem__

  • Use segment = dataset["test"] to get segment by name instead of segment = dataset.get_segment_by_name("test").

  • Use segment_names = dataset.keys() to get all segment names in a dataset.

• Add following methods to convert between category and index for writing training code easier

  • CategoriesMixin.get_category_to_index

  • CategoriesMixin.get_index_to_category

• Add following exceptions as subclasses of ResponseError

  • AccessDeniedError

  • InvalidParamsError

  • NameConflictError

  • RequestParamsMissingError

  • ResourceNotExistError

  • ResponseSystemError

  • UnauthorizedError

• Support skip_uploaded_files flag in GAS.upload_dataset for fusion dataset

• Add open dataset loader COVID-chestxray and nuScenes

Python SDK Improvements:

• Refactor CLI related code to a new module

• Stop checking the commit_id in DatasetClientBase.__init__ to avoid sending redundant request

• Fix the possibly unbound variable warning in CompCars

Python SDK Documentation:

• Add Update Dataset, Update Label and Update Data chapter

• Add docs for specific response exceptions

• Add continuity and tracking in glossary

• Update docs for reading segments from lazy evaluation Dataset rather than DatasetClient

• Refine the example in docs

Python SDK Deprecations:

• Deprecate DatasetBase.get_segment_by_name

2021-05-12

Python SDK Interface Adjustment:

• Rename the following exceptions

  • TensorBayClientException -> ClientError

  • TensorBayOpendatasetException -> OpenDatasetError

2021-05-06

New Features:

• Filter by task types on the open datasets list page, so that you can quickly find the required dataset.

• You can modify the dataset name, URL and alias.

• A guide to help new users fill in basic information.

• Dataset discussion tab. You can post discussions on datasets (in internal testing, and currently available for MINST, BDD100K, nuScenes, CityScapes, KITTI-Object, CIFAR-10, and COCO).

• Fork records of the open datasets.

Enhanced Features:

• Optimized the UI design and interface of the data list page, and added filter logic for annotation information.

• Optimized the UI design and interface details of the visualization widgets.

Python SDK New Features:

• Implement PagingList to lazy access elements from paging requests, which follows Sequence protocol

• Use PagingList as the return value instead of iterator for the folloing methods:

  • GAS.list_dataaset_names

  • DatasetClientBase.list_drafts

  • DatasetClientBase.list_commits

  • DatasetClientBase.list_tags

  • DatasetClientBase.list_branches

  • DatasetClientBase.list_segment_names

  • SegmentClient.list_data_paths

  • SegmentClient.list_data

  • FusionSegmentClient.list_frames

• Support creating dataset with auth cloud storage:

  • Add GAS.get_auth_storage_config and GAS.list_auth_storage_configs

  • Add GAS.create_auth_dataset

• Add client.config to adjust the request configuration

  • Support adjusting the config of the request retry strategy: config.timeout, config.max_retry etc.

  • Support uploading/reading data from cloud server internal endpoint

• Build TensorBay exception system:

  • Add TensorBayException as TensorBay base exception

  • Add NoFileError and FileStructureError for opendataset module

  • Add CommitStatusError, ResponseError, DatasetTypeError and FrameError for client module

  • Add TBRNError for CLI

• Add bin_point_cloud_fields to dataset Notes to support .bin format point cloud with different fields

• Display the upload progress by process bar in GAS.upload_dataset and (Fusion)DatasetClient.upload_segment

• Add open dataset loader opendataset.HalpeFullBody and opendataset.BioIDFace

Python SDK Improvements:

• Update open dataset name according to TensorBay latest naming rule

• Display commit_id in Commit.__repr__

• Refine the error message of unexpected status code

• Delete duplicated loads lexicon code on SentenceSubcatalog

Python SDK Documentation:

• Add docs for "Cloud Storage"

• Add docs for "Request Configuration"

• Add docs for "Use Internal Endpoint"

• Add docs for TensorBay exception system

• Add docs for bin_point_cloud_fields

• Add tag to glossary docs

• Refine the docstring and docs

• Fix typos in docstring and docs

Python SDK Deprecations:

• Deprecate the start and stop arguments for methods using PagingList as a return value

• Deprecate the following legacy exceptions in client module :

  • GASDataTypeError

  • GASLabelsetError

  • GASLabelsetTypeError

  • GASFrameError

  • GASResponseError

2021-04-21

Python SDK Bug Fixes:

• Fix UnboundLocalError when calling DatasetClientBase.create_tag with revision

• Fix KeyError when getting a FusionSegment instance

2021-04-19

New Features:

• You can view multiple annotation types simultaneously with the visualization widgets.

• You can apply for or share the dataset permissions. The dataset Admin can give users the corresponding permissions of the dataset.

• Dataset permissions and team management log.

• Automatically generate PythonSDK code and display API on the dataset details page.

Enhanced Feature:

• Optimized the UI design of the product pricing page.

Python SDK New Features:

• Add basic methods for dataset Version Control

  • Add DatasetClientBase.create_tag

  • Add DatasetClientBase.list_tags

  • Add DatasetClientBase.get_tag

  • Add DatasetClientBase.delete_tag

  • Add DatasetClientBase.list_branches

  • Add DatasetClientBase.list_commits

  • Add DatasetClientBase.get_draft

• Support dataset with continuous data

  • Add Notes to store dataset basic information

  • Add DatasetClientBase.update_notes

  • Add DatasetClientBase.get_notes

• Support "Fusion Dataset"

• Make request session safe in multiprocesses environment

• Add SDK version info to "Event Tracking" and support "Event Tracking" for CLI

• Add loader for CADC opendataset

• Add method create_segment() for dataset client

• Add __eq__ for Label

Python SDK Improvements:

• Modify Tensorbay gateway to "gatewayv2"

• Refine the NotImplemented logic in binary operators

• Check whether the url starts with "https://" in Client

• Implement decorator Deprecated for deprecated functions

Python SDK Packaging:

• Add minimum versions for dependancies

Python SDK Documentation:

• Add docs for dataset Version Control

• Add docs for "Fusion Dataset"

• Add docs for dataset with continuous data and Notes

• Update urls in docs

• Refine the docstring and docs

• Fix typos in docs

• Add examples to docstring

Deprecations:

• Deprecate DatasetClientBase.list_draft_titles_and_numbers, use DatasetClientBase.list_draft instead

2021-03-25

Python SDK New Features

• Support uploading data to Azure

Python SDK Fix Bugs

• Correct dataset names in data loaders according to Graviti Open Dataset

Python SDK Documentation

• Fix typos in docs

• Remove the url related content in the doc of CLI

• Refine the content of docs and docstring

• pdate the urls in docs and "README.md"

• Fix typos in docs

2021-03-24

New Features:

• Visibility Settings. You can set the visibility of a dataset as public or private.

• Team Collaboration. You can create teams and invite members to their teams.

• Individual & Team Profiles

• Data visualization is available after data list filtering.

• release TensorBay Python SDK

Enhanced Features:

• Upgraded UI design .

• Optimized the process of creating new datasets and unified the interface of creating datasets (filter, merge, fork, etc.).

2021-02-19

New Feature:

• 2D Keypoints type for data visualization widgets.

2021-02-01

New Features:

• Sensor display for data visualization. The corresponding sensor name can be clearly viewed when displaying multi-sensor data.

• Light-color mode for data visualization. Users can switch between Light and Dark Mode.

Enhanced Features:

• Optimized the UI, interaction and loading speed of data visualization.

• Optimized the UI and interaction of the distribution visualization.

2021-01-25

New Features:

• Users can select the region where the Bucket is stored when uploading data on TensorBay.

• Version Control for TensorBay cloud authenticated data and AWS authentication.

• You can merge the annotations of the same type and the same label table.

• "Closed" status in Feedback.

Enhanced Feature:

• Optimized the display of text and images in the Feedback.

2021-01-05

New Features:

• Users can merge data from different datasets on TensorBay.

• Version Control for datasets after the annotations are synced.

• Designated reply in the Feedback Module enables users to reply to a specific message.

• "Disable Reminders" of the reply pop-up window in the Feedback Module.

Enhanced Features:

• Optimized the display of the Feedback Module on the mobile side.

• Optimized the statistical mode of the attribute data of the label distribution visualization widgets.

2020-12-21

New Features:

• Graviti Open API, please refer to Graviti Open API for details.

• Full-screen function for visualizing label distribution.

Enhanced Features:

• Optimized the UI design of the label distribution visualization widgets.

• Optimized the user experience of adding feedback.

2020-12-02

New Features:

• Users can create a new dataset by filtering data.

• Dataset types and custom labels are available when creating a new dataset.

• Audio data visualization is available for MP3 and WAV files. Added two annotation types: transcription and classification.

• Text data visualization is available for txt files and their annotation classification.

• You can visualize attribute statistics of data annotation.

Enhanced Features:

• Optimized the logic of deleting data.

• Removed the corresponding annotations when a file is deleted.

• Raw data that has already been cited will not be deleted.

• Versions can be deleted.

2020-11-18

New Features:

• Access TensorBay via cloud storage authentication.

• Graviti Developer Tools menu and documentation are added to introduce the use of SDK and other tools.

• Code samples for the use of API.

• Feedback board allows you to post feedback and suggestions, communicate in real time, and send messages through WeChat official accounts.

• Pie chart mode to visualize data distribution.

Enhanced Features:

• Optimized the Help Doc and highlighted the developer documentation.

• Optimized the UI design and interface of the official website.

2020-11-09

New Features:

• Version Control for Datasets & Annotation sets. Raw data and annotations are included when the dataset version is released.

• Open datasets can be forked and accessed on GAS where users can release versions, upload data and perform other operations.

• Project 3D point cloud annotation info onto the corresponding 2D image, visualize Gzip compressed point cloud and select the annotation box of 3D view to automatically turn the view angle.

• View sub-category with the data distribution visualization widgets.

• The order management system where you can purchase team seats and expand TensorBay capacity.

Enhanced Feature:

• Optimized account types to "Developers" and "Teams". Visit the link for details.

2020-10-19

New Features:

• On TensorBay My Datasets, users can manage raw data versioning, create new versions, and continue to edit and modify the data of the dataset after creating a version.

• The file list on the left side of the visualization widgets helps users quickly locate and switch the displayed files.

• 2D Classification, 3D type, Tracking type data and its annotations.

• You can view multiple annotations in the open datasets with the visualization widgets.

Enhanced Features:

• Optimized the return function of visualization widgets when sharing to off-site.

• Optimized the release page UI of GroundTruth My Annotation Order.

2020-09-14

New Features:

• You can filter data with segment and view data list on My Datasets.

• You can view the annotation details of open datasets, filter list and label, and visualize annotations and label distribution.

• You can now download final performance review on GroundTruth.

• You can download the JSON file of the project output in advance during the final review or approval phase on GroundTruth.

2020-08-24

New Features:

• Access to open datasets. On the GAS platform, users can acquire open datasets to view, download and visualize.

• Data visualization widgets: 2D rectangular boxes, 2D polygons, and 2D classification. The widgets can check the annotation quality and can be shared off-site.

• Data distribution visualization widgets. Users can view the label distribution of a dataset.

2020-07-21

New Features:

• AccessKey: When using PythonSDK, users need to obtain their AccessKey for identity and permission authentication.

• PythonSDK: Users can upload datasets to GAS through PythonSDK.

• Label filtering for annotation sets. You can filter an annotation set by labels on the annotation details page.

• Users can download the JSON files of a single project in the approval records.

2020-07-06

New Features:

• Help Center: a detailed introduction to GAS features.

• Enterprise users can post data requests on TensorBay to obtain or provide data.

Enhanced Features:

• Optimized the UI and interaction of the platform.

• Optimized the layout of the home page and the left navigation bar, highlighting TensorBay and GroundTruth.

• Renamed the "Individual Edition" of GAS platform to "Community Edition", with no change in functions.

2020-06-17

New Features:

• Message notification type.

• Individual users invited to My Annotation project will receive an invitation message. After processing, the user will be notified with an accepted/rejected reply.

• Enterprise users invited to join the team will receive an invitation message. After processing, the user will be notified with an accepted/rejected reply.

Enhanced Feature:

• Optimized the interaction of label selection, added English name content, and allowed users to customize label colors.

2020-05-28

New Features:

• Switch platform language between Chinese & English.

• The annotation committee establishes the standards for each annotation, determines annotation quality, ensures quality control, and reviews the annotations.

• Three types of WeChat official account notification s.

• When all my annotation tasks are completed, the project creator will receive a push notification.

• When annotation orders are awaiting confirmation, the project creator will receive a push notification.

• When annotation orders are awaiting approval, the project creator will receive a push notification.

• Annotation completion report. You can download the report from the order details page after the order is completed. The report includes the total number of labels, accuracy rate, approval records, capacity report, etc.

• You can upload datasets in local zip file and the file will be automatically decompressed and saved after uploading to GAS.

2020-05-13

New Features:

• Instructions on role-based access control for Enterprise users.

• Enterprise users can invite members to join the enterprise on the enterprise member management page.

• Enterprise Admin can manage and modify the roles of the members on the enterprise member management page.

• Notification Center. The platform pushes messages such as member invitations, permission applications and project progress reminders.

• Sandbox model training (in internal testing). Please refer to the sandbox training section for details.

Enhanced Features:

• Optimized the dataset viewing. After clicking View Data on the data platform, users will be automatically directed to the annotation platform to view the data.

• Optimized the dataset selection interface when creating a new project, and sorted the dataset list by creation time.

2020-04-20

New Feature:

• Distinguish between Individual and Enterprise users on the home page.

Enhanced Feature:

• Optimized the order performance data processing algorithm. Now the number of boxes is used as the statistical unit.

2020-04-16

New Features:

• Users can modify their names in the personal center.

• Note for non-Chrome users to use Chrome to improve user experience.

Enhanced Feature:

• Optimized the UI of the sign-in interface.

2020-04-06

New Feature:

• View sample annotations: click view sample annotations when the order is confirmed.

Enhanced Feature:

• Optimized the guidance for enterprise user authentication to facilitate mailbox authentication.

2020-03-30

Enhanced Feature:

• Optimized the copywriting of SMS verification code.

2020-03-13

New Features:

• User self-registration. Users can register their own accounts on the Graviti official website as an individual edition user. For enterprise edition users, please contact Graviti customer service for registration.

• User authentication. Individual edition users can complete email authentication in the personal center. After authentication, they can become authenticated users and enjoy the rights of authenticated users.

• My Annotation. You can create annotation projects and invite up to four members to join.

• Enterprise member role management. Enterprise Admin can manage the roles of enterprise members on the enterprise member management page.

Enhanced Feature:

• Optimized the order release process. Users can now directly select datasets to release orders.

2020-02-29

New Features:

• Order progress, capacity, and total amount.

• Rejected records. Users can view the records of accepted or rejected projects.

• Demand analysis feedback records. Users can view all the demand analysis feedback of the orders and view the sample annotations.

• The annotation service process is introduced when creating an order.

Enhanced Features:

• Optimized the description of the order status.

• Original order status: order in parsing, pending confirmation, customer feedback, order in progress, completed order.

• New order status: parsing, annotating and completed.

• Parsing refers to the orders that need the parsing confirmation. For the orders to be confirmed, the label "awaiting confirmation" is displayed in the upper right corner of the order.

• Annotating refers to the confirmed orders that have not been fully approved. For the orders to be approved, the label "awaiting approval" is displayed in the upper right corner of the order. Annotation progress calculation: approved data volume/total data volume.

• Completed refers to the orders that have completed all the processes and acquired approval.

2020-02-18

New Feature:

• Approval records. Users can view the approval records.

2020-01-14

New Features:

• Notification for binding the WeChat official account. When users follow the Graviti official account and bind it with their GAS accounts, they can receive reminder messages of the project progress.

Enhanced Features:

• Optimized the export format of annotations, converted the relative coordinates of 3D annotations to absolute coordinates, and unified the output format of annotations.

2020-01-06

New Features:

• Orders on the annotation platform are directly linked to datasets on the data platform, and users can directly select the datasets when placing orders.

Enhanced Features:

• Optimized item numbering from the original 32-digit code to a shorter and easier-to-use code.

• Optimized the display of project performance: separately display the annotation progress and the quality inspection progress to avoid confusion.

• Optimized the display of annotation type: the original icon is replaced by text.

2019-12-23

Enhanced Features:

• Optimized the UI of the sign-in interface.

• Optimized the order of the project list: sorting by creation time instead of project number.