blog.paperspace.com Open in urlscan Pro
2a04:4e42:600::775  Public Scan

Form analysis
3 forms found in the DOM

https://blog.paperspace.com/search

<form x-ref="search_form" data-action="https://blog.paperspace.com/search" action="https://blog.paperspace.com/search" class="f-search__form" @submit.prevent="">
  <label for="search-mobile-menu" class="sr-only"> Search </label>
  <input id="search-mobile-menu" x-ref="search_input" x-model="query" type="search" placeholder="Search in all our content" class="f-search__input no-appearance" @keydown.enter="performSearch" @keydown.escape="close">
</form>

https://blog.paperspace.com/search

<form x-ref="search_form" data-action="https://blog.paperspace.com/search" action="https://blog.paperspace.com/search" class="f-search__form" @submit.prevent="">
  <label for="search-desktop-top-bar" class="sr-only"> Search </label>
  <input id="search-desktop-top-bar" x-ref="search_input" x-model="query" type="search" placeholder="Search in all our content" class="f-search__input no-appearance" @keydown.enter="performSearch" @keydown.escape="close">
</form>

<form data-members-form="subscribe" id="newsletter-form" class="f-auth-form no-image">
  <h3 class="f-auth-form__title"> Subscribe to our newsletter </h3>
  <p class="f-auth-form__subtitle"> Stay updated with Paperspace Blog by signing up for our newsletter. </p>
  <div class="f-auth-form__fieldset no-image">
    <label for="newsletter-input" class="sr-only"> Your email address </label>
    <input data-members-email="" id="newsletter-input" class="f-auth-form__input no-appearance" type="email" required="" placeholder="Your email address">
    <button id="newsletter-button" class="f-button primary medium in-auth-form" type="submit"> Join now <span class="icon-chevron-right" aria-hidden="true"></span>
    </button>
  </div>
  <p class="f-auth-form__success"> 🎉 Awesome! Now check your inbox and click the link to confirm your subscription. </p>
  <p class="f-auth-form__invalid f-error-message bottom-space"> Please enter a valid email address </p>
  <p class="f-auth-form__error f-error-message bottom-space"> Oops! There was an error sending the email, please try later </p>
</form>

Text Content

Main links
 * Announcements
 * Tutorials
 * ML
 * CV
 * NLP
 * 3D
 * 💎 Get paid to write
 * We're hiring!

--------------------------------------------------------------------------------

Secondary links
 * Docs
 * Community Forum
 * Contact Sales

--------------------------------------------------------------------------------


Light Dark System
Sign up Sign in
Search

Press Enter to search

 * Announcements
 * Tutorials
 * ML
 * CV
 * NLP
 * 3D
 * 💎 Get paid to write
 * We're hiring!

More
 * Docs
 * Community Forum
 * Contact Sales
 * Light Dark System

Introducing Gradient Datasets and an all-new Gradient Notebooks IDE!

Sign up Sign in
Search

Press Enter to search


Announcement


INTRODUCING GRADIENT DATASETS AND AN ALL-NEW GRADIENT NOTEBOOKS IDE!

We just released an enormous notebooks update with the addition of Gradient
Datasets, support for interactive widgets, and improvements to cell, file, and
kernel management.

3 days ago   •   5 min read

By David

Table of contents
 1. Introducing public and private Gradient Datasets
 2. Interactive widgets
 3. IProgress and PyTorch/TensorFlow dataloaders
 4. plotly and other plotting libraries with HTML outputs
 5. Cell management updates
 6. Updated file manager
 7. Kernel management
 8. Bonus: Terminal updates!
 9. Try it out

In the latest update for Gradient Notebooks, we've introduced a number of new
features and improvements – including Gradient Datasets, support for interactive
widgets, better cell, file, and kernel management, and plenty more!

Let's get right to the updates!


INTRODUCING PUBLIC AND PRIVATE GRADIENT DATASETS

Gradient Datasets provide an alternative to local notebook storage that can be
used across Gradient teams and resources. With this release, it's now possible
to mount a dataset within a notebook.

Datasets are available in the Datasets tab of the IDE and files are stored in
the /datasets directory.

As part of this release, we've made available a number of common datasets
available to all notebooks as public datasets. These datasets are available in
the Public tab within the Datasets menu in the IDE.

0:00
/0:07
1×
Mounting the tiny-imagenet-200 dataset.

Public datasets are updated frequently. The initial batch of public datasets
includes:

 * Tiny ImageNet 200: 100000 images of 200 classes (500 for each class)
   downsized to 64×64 colored images. Each class has 500 training images, 50
   validation images and 50 test images.
 * OpenSLR: The LibriSpeech ASR corpus is composed of approximately 1000 hours
   of 16kHz read English speech, prepared by Vassil Panayotov with the
   assistance of Daniel Povey. The data is derived from read audiobooks from the
   LibriVox project, and has been carefully segmented and aligned.
 * MNIST: A database of handwritten digits has a training set of 60,000
   examples, and a test set of 10,000 examples. It is a subset of a larger set
   available from NIST. The digits have been size-normalized and centered in a
   fixed-size image.
 * LSUN: contains 10 scene categories, such as dining room, bedroom, chicken,
   outdoor church, and so on. For training data, each category contains a huge
   number of images, ranging from around 120,000 to 3,000,000. The validation
   data includes 300 images, and the test data has 1000 images for each
   category.
 * FastAI: Paperspace's Fast.ai template is built for getting up and running
   with Practical Deep Learning for Coders. The corresponding public dataset
   enables notebooks created using the FastAI runtime quick access to the needed
   demo data.
 * COCO: this dataset is a large-scale object detection, segmentation, key-point
   detection, and captioning dataset. The dataset consists of 328K images,
   bounding boxes, and their labels.

If you want to create your own dataset, simply use the Team tab within the
datasets menu in the notebook IDE to upload and mount your own data.

Here's an example of how to upload a dataset of historic artwork and then
accessing the dataset in a notebook with the command !ls
../datasets/historic_art/:

0:00
/0:46
1×
Uploading and mounting a dataset within a notebook.

For datasets larger than 5 GB, you will be prompted to upload your data using a
Gradient Workflows or the Gradient CLI.

For more information on Gradient's public datasets and data storage, please read
through the relevant documentation.


INTERACTIVE WIDGETS

In addition to datasets, notebooks now support interactive ipywidgets out of the
box!

0:00
/0:05
1×
Displaying a GIF file with ipywidgets.

Jupyter widgets or ipywidgets are useful in a variety of contexts, from
modifying the appearance and interpretability of a notebook to enabling a number
of deep learning functionalities. Widgets are now available natively – just
import the ipywidgets module!

ipywidgets also enable a host of other widgets natively within a notebook, from
input prompts to sliders, multiselects, calendars, and more.

0:00
/0:26
1×
Widgets also enable sliders, calendars, and more.

Check out the ipywidgets docs for a full list of widgets.


IPROGRESS AND PYTORCH/TENSORFLOW DATALOADERS

Notebooks now also support IProgress text progress bars.

0:00
/0:07
1×
IProgress helps provide visual cues for operations that take time to complete.

IProgress is used frequently to display useful information like how how many
epochs for training remain in a session. With this update, IProgress now renders
fully in the notebook.

0:00
/0:15
1×
An example of IProgress used with TensorFlow Datasets.

This extends in particular to both TensorFlow and PyTorch's extended suite of
libraries. Functions from libraries like TensorFlow Datasets and Pytorch
Lightning now work with no issue.

0:00
/0:22
1×
An example using the PyTorch fit method.

In addition, progress bars are now enabled for TensorFlow and PyTorch data
loaders and training functions to display natively in the notebook. It's no
longer necessary to add code into a Python script executed through the terminal
to run code containing these functions.


PLOTLY AND OTHER PLOTTING LIBRARIES WITH HTML OUTPUTS

With ipywidgets facilitating HTML outputs, we can now make full use of the
interactive plotting library plotly.

0:00
/0:23
1×
Example using Plotly.

Unlike Matplotlib or Seaborn, plotly allows for making interactive, dynamic
changes to the existing plot like removing data classes or zooming. Now we can
create plotly graphics and even save them to be embedded on other web pages.

We look forward to seeing what you can do with full widget support.

Now let's talk about updates to the IDE itself.


CELL MANAGEMENT UPDATES

First up, we've greatly enhanced and expanded cell operations within notebooks
to include familiar concepts from JupyterLab like join, split, insert, and more.

0:00
/0:10
1×
The new Gradient Notebooks IDE makes it easy to cut, copy, paste, join, split
cells, and more.

The updated Notebooks IDE also makes it easy to hide cell outputs to clear up
more space within a notebook.

0:00
/0:09
1×

We've also expanded the command palette to make it easier to access helpful
shortcuts and commands. The list of command palette entities is growing rapidly
so be sure to check it out!

0:00
/0:24
1×
Creating a new notebook from the command palette.

The command palette is accessible with the keyboard shortcut command + p.


UPDATED FILE MANAGER

We've also introduced drag-and-drop functionality and a few other useful actions
to the file manager.

0:00
/0:24
1×
Moving files with the drag-and-drop file manager.

In addition, it's now possible to upload multiple files to a folder and there
are a number of new file management options available when right-clicking on a
file or folder.

0:00
/0:24
1×
Right click on a file to perform a number of actions like renaming, downloading,
copying, and more.


KERNEL MANAGEMENT

It's now easier than ever to select, stop, and restart a notebook kernel.

0:00
/0:29
1×
Using the kernel selection window to select a Python 3 kernel for a new
notebook.

Navigate to the kernel sessions manager in the bottom left of the notebooks IDE
to interact with each notebook kernel in real time. Use the appropriate buttons
to stop and restart the kernel.


BONUS: TERMINAL UPDATES!

As a bonus for Pro and Growth users, we've moved the terminal into the notebook
IDE as a split-screen item!

0:00
/0:20
1×
Pro and Growth plan users can now interact with their notebooks simultaneously
while using the new terminal.

It's now possible to issue terminal commands without leaving the notebook file
itself.


TRY IT OUT

Ready to try out the new Gradient Notebooks IDE?

Try creating a new notebook in Gradient or go ahead and fork a project from the
ML Showcase.  

Be sure to let us know about your projects don't hesitate to contact support if
you have any questions!

Add speed and simplicity to your Machine Learning workflow today

Get startedContact Sales

 * Tags:
 * Announcement


SPREAD THE WORD

 * Share
 * Tweet
 * Share
 * Copy
 * Email

public

Next article


IMPLEMENTING CONDITIONAL GENERATIVE ADVERSARIAL NETWORKS

public

Previous article


INTERPRETING COMPUTER VISION MODELS


KEEP READING

public


FILE UPLOADS ARRIVE IN GRADIENT NOTEBOOKS

10 months ago   •   2 min read
public


GRADIENT NOTEBOOKS JUST GOT THE BIGGEST UPDATE SINCE 2019

a year ago   •   4 min read
public


NEW! CONSOLE REDESIGN

a year ago   •   1 min read



SUBSCRIBE TO OUR NEWSLETTER

Stay updated with Paperspace Blog by signing up for our newsletter.

Your email address Join now

🎉 Awesome! Now check your inbox and click the link to confirm your
subscription.

Please enter a valid email address

Oops! There was an error sending the email, please try later

Main links
 * Announcements
 * Tutorials
 * ML
 * CV
 * NLP
 * 3D
 * 💎 Get paid to write
 * We're hiring!

Secondary links
 * Docs
 * Community Forum
 * Contact Sales

Social links
 * Facebook
 * Twitter

© Paperspace Blog 2022

Built with ❤️ in Brooklyn




Conversations

new message(s)

Need a hand?