Visualisation and Analysis of Spatially Resolved Transcriptomics Data.

VR-Omics

This is the page for the VR-Omics v1.0.

A new version is available here:

 

Abstract

Spatially resolved transcriptomics is an emerging class of Low-throughput technologies that enable biologists to systematically investigate spatiotemporal gene expression patterns.

Upon data acquisition, one major hurdle is the subsequent interpretation and visualization of the datasets acquired. To address this challenge, we present a novel data visualization system with interactive functionalities in virtual reality, using an embedded automated workflow for analysis and data processing. The application is designed to help biologists to analyse and interpret spatially resolved transcriptomic datasets. Supported are various technologies such as Visium and Xenium by 10X Genomics, STOmics by BGI, MERFISH by VIZGEN or Tomo-seq. The system is implemented as a local 2D desktop application or as an immersive environment using head-mounted display virtual reality. This allows biologists to interact with the data in novel ways not previously possible, which includes visually exploring the gene expression patterns of an organ and comparing genes based on their 3D expression profiles.

Download VR-Omics v1.0

Documentation

Automated Workflow

Quick Access Visualisation Features

VR-Omics Setup
1 Download VR-Omics

Click the Download VR-Omics button to obtain VR-Omics from our repository.

Download VR-Omics v1.0
2 Download VR-Omics

Click the Download button to retrieve VR-Omics from figshare/monash bridges.

3 Unzip the folder

To unzip the folder, right-click on the zip file and select Extract here.

4 Start VR-Omics

Once the folder is unzipped, open it and click on the VR-Omics.exe.

VR-Omics Automated Workflow
Visium
Download
1 Download dataset without filter or spatial analysis
  1. From the main menu select Visium
  2. Select Download
  3. Select dataset from the dropdown
  4. Leave all other selections blank to not filter the dataset and select Download to download and process the data
1. + 2. Visium options menu

3. + 4. Download and process Visium data

The data will be downloaded from the 10X Genomics Resources Website and processed to be read in VR-Omics

The data will be stored in the VR-Omics folder on your local machine. ../VR-Omics/Assets/PythonFiles/sample/ To Visualise the data select the Visium Load function and select the whole folder from the Browse menu.
2 Download and filter dataset

Combinable with: Spatial Analysis Output Plots Filter

  1. From the main menu select Visium
  2. Select Download
  3. Select dataset from the dropdown
  4. Filter dataset by entering the respective parameters into the Input boxes (optional).
  5. Click Download to continue.

Image 1. + 2. see options menu.

  • Only filter steps containing a value will be processed, fields left blank will be ignored.
  • The data is filtered using Scanpy.
3. - 5. Download, filter and process Visium data

The data will be downloaded from the 10X Genomics Resources Website and processed to be read in VR-Omics

The data will be stored in the VR-Omics folder on your local machine. ../VR-Omics/Assets/PythonFiles/sample/ To Visualise the data select the Visium Load function and select the whole folder from the Browse menu.
3 Download dataset and perform spatial analysis

Combinable with: Filter Output Plots

  1. From the main menu select Visium
  2. Select Download
  3. Tick the Spatially Variable Genes box
  4. Continue by clicking Download

Image 1. + 2. see options menu.

  • The dataset will be downloaded, and a spatial variable gene analysis will be performed.
  • This step usually takes around 30 minutes depending on your local machine and the size of the dataset.
  • Spatially variable genes analysis is performed using the Python package SpatialDE
3. + 4. Download, optional filter, spatially analyse and process Visium data

The data will be downloaded from the 10X Genomics Resources Website and processed to be read in VR-Omics

The data will be stored in the VR-Omics folder on your local machine. ../VR-Omics/Assets/PythonFiles/sample/ To Visualise the data select the Visium Load function and select the whole folder from the Browse menu.
4 Download data and include output plots

Combinable with: Filter Spatial Analysis

  1. From the main menu select Visium
  2. Select Download
  3. Tick the Create Plots box
  4. Continue by clicking Download
The automated workflow will produce a variety of output plots including:

For more details see export plots section.

  • Tissue image (H&E stain image)
  • Spatial cluster
  • Spatial gene counts
  • Histogram total counts
  • UMAPs
3. + 4. Download, optional filter, spatially analyse and process Visium data

The download menu accesses the 10X Genomics Resources Website and downloads the requested data automatically, while processing it to be read by the VR-Omics Visualiser.

The data will be stored in the VR-Omics folder on your local machine. ../VR-Omics/Assets/PythonFiles/sample/ To Visualise the data select the Visium Load function and select the whole folder from the Browse menu.
Load

Merging multiple Visium slides into one dataset

1 Load multiple Visium datasets
  1. From the main menu select Visium
  2. Select Load
  3. Click the Browse button and search for the sample folders of the Visium slice (Ensure the folder has this format.)*

* The folder will be in the right format if the sample was downloaded using the VR-Omics Automated Workflow or the Sample has been processed using the Automated Workflow beforehand.

2 Select sample folders Select all sample folders (main folder of the dataset) in the Explorer menu and click Load
3 Arrange the order of the samples

Each sample will be shown in an individual container, showing the respective stained tissue image, the name of the sample, and the order in how the samples should be mapped into 3D context from top town.

Arrange the order of the samples by clicking ˄ or ˅.

Delete a sample by pressing the bin button 🗑. The tissue image can be expanded by clicking the expand button on the image.

If the tissue image wasn't found a default VR-Omics placeholder will appear. This means the file wasn't identified. Please ensure that the respective file is named tissue_hires_image.png and that no other file in the directory has the same name.

The dataset can be visualised and explored without a tissue image with some limited functionalities. Therefore, skip the Alignment process by clicking Align and then Go! without changing any of the settings.

4 Rotate the samples in the 3D mapping tool

From the dropdown select which sample to operate on, all other samples are fixed.

Use the slider to set the transparency of the current selected sample.

Tick the boxes of each sample that currently should be visualised. All unselected samples will be invisible.

Use the + Button to rotate the slice clockwise or the - Button to rotate it counter clockwise.

This allows aligning the samples if they have been misplaced or rotated on the capture area.

The slices can still be rotated in the VR-Omics Visualiser later to further adjust them.

5 Set the distances between the samples

In the text box at the bottom left enter the distances between the samples.

The distances are applied from front to back. The first value sets the distance between the first and the second slide. The second value sets the distance between slice two and three.

Enter the values separated by a comma (e. g. 10,20,50,10)

Click the Go! button if all adjustments are made to visualise the combined dataset in the VR-Omics Visualiser.


Using a single Visium slide

1 Load a single Visium dataset
  1. From the main menu select Visium
  2. Select Load
  3. Click the Browse button and search for the sample folder of the Visium slide. Select the main folder as shown in the figure. Only Data processed or downloaded with VR-Omics can be used, otherwise ensure the folder has this format.*

* The folder will be in the right format if the sample was downloaded using the VR-Omics Automated Workflow or the Sample has been processed using the Automated Workflow beforehand.

2 Select sample folder Select the sample folder (main folder of the dataset) in the Explorer menu and click Load
3 Confirm selection

The sample will be shown in a container showing the tissue image that can be expand by clicking on the button in the image.

Select the sample by clicking Align

If the tissue image wasn't found a default VR-Omics placeholder will appear. This means the file wasn't identified. Please ensure that the respective file is named tissue_hires_image.png and that no other file in the directory has the same name.

The dataset can be visualised and explored without a tissue image with some limited functionalities. Therefore, skip the Alignment process by clicking Align and then Go! without changing any of the settings.

4 Rotate the samples in the 3D mapping tool

The dropdown menu shows the name of the selected sample folder

Use the slider to set the transparency of the tissue image.

Use the + Button to rotate the slice clockwise or the - Button to rotate it counter clockwise.

This allows aligning the samples if they have been misplaced or rotated on the capture area.

The slices can still be rotated in the VR-Omics Visualiser later to further adjust them.

Click the Go! button if all adjustments are made to visualise the combined dataset in the VR-Omics Visualiser.

5 Skip the distance input field

Ignore the text box in the bottom left for the distances if using a single Visium slide.

Click the Go! button if all adjustments are made to visualise the combined dataset in the VR-Omics Visualiser.

Process
1

Process Visium dataset from local machine

Combinable with: None

  1. From the main menu select Visium
  2. Select Process
  3. Click Browse and select the visium folder from your local machine.
  4. The folder must contain a spatial folder and a h5 file named filtered_feature_bc_matrix.h5.
  5. Select the Skip Filter Step toggle only if you wish to skip the filter and SVG step and only prepare the data for the Visualiser.
  6. Click the Next button to continue.
  7. The output will be saved in the VR-Omics directory. NAvigate to where the VR-Omics software was downloaded. From here navigate to Assets/PythonFiles The output can be visualised using the Load feature.

This step needs to be performed for every dataset that was not downloaded using the VR-Omics Download option.

Optionally, the Skip Filter Step option can be used if the dataset does not need to be filtered.

The output will be saved in the VR-Omics folder

2

Process and Filter Visium dataset from local machine

Combinable with: Spatially Variable Genes

  1. From the main menu select Visium
  2. Select Process
  3. Click Browse and select the visium folder from your local machine.
  4. The folder must contain a spatial folder and a h5 file named filtered_feature_bc_matrix.h5.
  5. Unselect the Skip Filter Step toggle if you wish to filter and prepare the data for the Visualiser.
  6. Click the Next button to continue.
  7. Select the filter parameters.
  8. Optionally, create the output plots by selecting the Include Plots toggle.
  9. Optionally, perform spatial analysis by selecting the SVG Analysis toggle.

The output will be saved in the VR-Omics folder

Demo
1 Explore the Demo dataset
  1. From the main menu select Visium
  2. Select Demo
2 Demo in Visualiser

This will automatically load the demo dataset in the VR-Omics Visualiser ready to be explored.

The cluster data is visualised in the screenshot, this is not the default.

Filter parameters

Min.count - Filter spots by gene count

Min.count is a filter used to exclude spots with gene expression lower than a specified value from further analysis. It is used to ensure more accurate and robust results in gene expression experiments.

Max.count - Filter spots by gene count

Max.count is a filter used to exclude spots with gene expression Lower than a specified value from further analysis. It is used to ensure more accurate and robust results in gene expression experiments.
Filter spots by percentage of MT count (minimum) MT.count (minimum) is the filter parameter used to exclude spots that have a lower Mitochondrial count than the specified value.
Filter spots by percentage of MT count (maximum) MT.count (maximum) is the filter parameter used to exclude spots that have a Lower Mitochondrial count than the specified value. A Low mitochondria count can be a sign of cell death or cell damage or stress.
Filter out genes that are detected in less spots than this value This minium threshold filter parameter can be used to exclude all genes from the dataset that are detected in less spots than the value provided. Keep in mind the total number of genes of the dataset. VR-Omics will skip this step if this value was selected to Low so that no genes remain or if the value exceeds the total genes number of the dataset.
Filter out spots that have less genes expressed than this value. This minium threshold filter parameter can be used to exclude all spots from the dataset that have less genes expressed than this value. Please keep the maximum number of spots in the dataset in mind. VR-Omics will skip this step if the value was selected so Low, that no spots would remain after analysis.

Further information can be found in the Scanpy spatial analysis documentation.

Visium folder required format

Please ensure this structure of your Visium data to use the VR-Omics Visualiser. This structure will automatically be generated by all sample datasets that are either downloaded or processed using the VR-Omics Automated Workflow.

Xenium
Process

Process Xenium data

1 Navigate to the Xenium process menu
  1. From the main menu select Xenium
  2. Select Process
2 Select the Xenium files
  • Select the cell feature matrix .h5 file of the Xenium data using Browse.
  • Select the cells csv file of the Xenium data using Browse.
  • Optionally select a Min Count value to filter the data
  • Optionally select a Min Cells value to filter the data
  • Select the Run Full Analysis toggle if you want to perform additional spatial analysis (Moran Results)
  • Only one public dataset was available during development of VR-Omics

    The dataset can be downloaded from 10X Genomics.

    3 Confirm selection

    Click Process to process the data.

    The processed data will be saved in the VR-Omics directory. From the directory navigate to Assets/PythonFiles/ the folder starts with Xenium_output_....

    Select the whole folder containing Xenium for the Upload to the Visualiser

    The process step can take a couple of minutes depending on the size of the dataset and the computational power of the computer used.

    Once the data was processed this step can be skipped and the data can be visualised using the Xenium load option.

    The processed data will be saved in the VR-Omics data folder. To Visualise the data select the complete folder as shown in the figure.

    Load
    1 Navigate to the Xenium load menu
    1. From the main menu select Xenium
    2. Select Load
    2 Select the Xenium files

    Select the Xenium folder processed with the VR-Omics AW (highlighted in green in the picture) using Browse.

    The data set can be found in the VR-Omics directory. Navigate from there to VR-Omics/Assets/PythonFiles/sample select the whole folder as shown in the picture

    Only one public dataset was available during development of VR-Omics

    The dataset can be downloaded from 10X Genomics.

    3 Confirm selection

    Click Visualise to continue to the VR-Omics Visualiser.

    Ensure the data has been processed before visualising it using the Process function.

    Tomo-Seq
    Load

    Load Tomo-Seq data

    1 Navigate to the Tomo-Seq load menu
    1. From the main menu select Tomo-Seq
    2. Select Load
    2 Select the Tomo-Seq files
  • Select the gene expression .csv file in AP* cutting direction using Browse.
  • Select the gene expression .csv file in VD* cutting direction using Browse.
  • Select the gene expression .csv file in LR* cutting direction using Browse.
  • Select the folder containing the reconstructed gene expression .txt files using Browse.
  • * AP = anterior to posterior, VD = ventral to dorsal, and LR = left to right

    The 3D reconstruction of the gene expression is explained in Asp et al. in Supplementary Data S2.

    STOmics
    Process

    Process STOmics data

    1 Navigate to the STOmics process menu
    1. From the main menu select STOmics
    2. Select Load
    2 Select the STOmics file

    Select the gene expression matrix .h5 file of the STOmics data using Browse.

    The dataset can be downloaded from STOmics Database.

    3 Confirm selection

    Click Process to process the data.

    The processed data will be saved locally.

    The process step can take couple of minutes depending on the size of the dataset and the computational power of the machine.

    Once the data was processed this step can be skipped and the data can be visualised using the STOmics load option.

    The processed data will be saved in the VR-Omics data folder. To Visualise the data select the complete folder as shown in the figure.

    Load
    1 Navigate to the STOmics load menu
    1. From the main menu select STOmics
    2. Select Load
    2 Select the STOmics files

    Select the processed gene expression STOmics .h5 file using Browse.

    Ensure the data was processed using the Process function.

    The processed data can be found in the VR-Omics data folder. To Visualise the data select the complete folder as shown in the figure.

    MERFISH
    Process
    1 Navigate to the MERFISH process menu
    1. From the main menu select MERFISH
    2. Select Process
    2 Select the MERFISH files
  • Select the Vizgen counts file .csv using Browse
  • .
  • Select the Vizgen cell_metadata .csv file using Browse
  • .
  • Select the Vizgen detected_transcripts .csv file using Browse
  • .
  • Optionally, enter filter parameters
  • Optionally, select the Run Full Analysis toggle to include spatial analysis (Moran Results)
  • The MERFISH data we used is from Vizgen, where there data is publicly available under their data release program.

    The processed data will be saved in the VR-Omics data folder. To Visualise the data select the complete folder as shown in the figure.

    Load
    1 Navigate to the MERFISH load menu
    1. From the main menu select MERFISH
    2. Select Load
    2 Select the MERFISH files
  • Select the MERFISH sample folder processed with the VR-Omics AW Process function Browse
  • .

    The processed data can be found in the VR-Omics data folder. To Visualise the data select the complete folder as shown in the figure.

    The MERFISH data used was provided by Vizgen where there data is publicly available under their data release program.

    Custom data
    Load
    1 Navigate to the Custom data load menu
    1. From the main menu select Custom data
    2. Select Load
    2 Select the Custom data files
  • Select the custom gene expression* .csv file using Browse
  • .
  • Select the custom meta data** .csv file using Browse
  • .
  • Optional: If the dataset contains three dimensions (X,Y, and Z) move the slider with the 2D label to the right.
  • .

    * Ensure the data is stored in a gene per location data file using columns for locations and rows for gene expressions

    ** The meta data file stores the X,Y and optional Z coordinates of the dataset. Each row needs to represent one location where the locations need to be in same order as in the gene expression file.

    3 Specify columns
  • For the location information uploaded in 2. provide the column that stores the respective information.
  • .
  • Select the Column for the X coordinates. For the first column enter 0 for the second column enter 1 etc.
  • Select the Column for the Y coordinates. For the first column enter 0 for the second column enter 1 etc.
  • Select the Column for the Z coordinates. For the first column enter 0 for the second column enter 1 etc.*
  • Select the Column for the Location IDs. For the first column enter 0 for the second column enter 1 etc.**
  • Tick the No CSV header box if the CSV files contain no header information.***
  • * Leave blank if no three dimensional dataset

    ** Leave blank if no IDs available

    *** The header is the first row in a csv file usually used to store the headers of each column.

    3D Object
    Load
    1 Navigate to the 3D object menu

    From the main menu select 3D object

    2 Select the 3D object file
  • Select the 3D object* using Browse
  • Enter the X, Y, and Z Coordinates where the object should be rendered**
  • Enter the X, Y, and Z Rotation of the 3D object***
  • * Only 3D object supported by Unity can be uploaded. More information can be found using the Unity documentation. This feature was tested with .fbx and .obj files.

    ** The coordinates are relative to the dataset, the dataset will always be rendered in the origin X,Y,Z → 0,0,0. If no coordinates available use 0,0,0. The 3d object can easily be moved within the VR-Omics Visualiser.

    *** The rotation is relative to the dataset, the dataset will always be rendered in the origin X,Y,Z → 0,0,0 facing the user with 0-rotation. If no rotation values are available use 0,0,0. The 3d object can easily be rotated within the VR-Omics Visualiser.

    Ensure the 3D object has the right measurements, the object can be resized within the VR-Omics Visualiser but if the object was uploaded top big, or too small compared to the rendered dataset this might lead to issues. In this case please adapt the dimensions of the object prior.

    3 Submit the object

    Store the selected 3D object by clicking Submit

    Ensure the object was submitted before uploading a spatial dataset. This can't be done after entering the VR-Omics Visualiser.

    4 Removing an object

    Remove all selected objects from the selection using Delete All

    Multiple objects can be uploaded, although this feature is only tested with one object.


    VR-Omics Visualisation
    Gene Search Features
    Feature Description Icon Image
    Gene search - Heatmap
    Visium Xenium STOmics Merfish Tomo-Seq Custom
    VR Demo

    To search for a gene (heatmap) using the search bar:

    1. Click on the search bar located at the top left of the menu panel.
    2. Start typing the name of the desired gene.
    3. The auto-complete feature displays results as buttons below the search bar.
    4. Click on a result to visualize the selected gene expression on the center of the screen.
    5. The gene expression values are normalised and can be referenced using the colour gradient legend located at the bottom left of the screen.
    Binary search - Gene is on
    Visium Xenium STOmics Merfish Custom
    VR Demo

    To search for a gene (gene is on) using the search bar:

    1. Move the Gene is on slider below the search bar to the right.
    2. Click on the search bar located at the top left of the menu panel.
    3. Start typing the name of the desired gene.
    4. The auto complete feature will display a list of possible results in the scroll view below the search bar. These results will be presented as buttons.
    5. Click on the desired result to visualise the selected gene expression on the data set in the centre of the screen.
    6. The gene expression values are normalised and can be referenced using the colour gradient located at the bottom left of the screen.
    Change if gene search contains or starts with term
    Visium Xenium STOmics Merfish Tomo-Seq Custom
    VR Demo

    By default, gene names entered into the search bar will only return results that start with the input.

    To also include gene names that contain the input, uncheck the Starts with Input box:

    • Click on the Starts with Input checkbox to unselect it.
    • The search will now include gene names that contain the input in addition to those that start with the input.
    Threshold - Minimum
    Visium Xenium STOmics Tomo-Seq Merfish Custom
    VR Demo

    By default, each location in the dataset is coloured according to the normalised gene expression values. If no value is found for a location, the location will be cleared.

    The threshold slider is set to 0% by default, which means that all locations with an expression value of 0 or Lower of the normalised values will be visualised. To focus on regions with a Low expression level of the gene, you can adjust the slider to a Lower position:

    • Move the threshold slider to the desired position.
    • All regions of the current gene expression pattern that are lower than the adjusted percentage of the normalised values will be cleared.
    The minimum threshold is set to 0% including every location of the dataset with expression levels 0 or Lower.
    The minimum threshold is increased to around 9%, clearing all locations with expression levels below 9% of the normalised values.
    Location Interaction Features
    Feature Description Icon Image
    Selecting Regions of Interest (ROI)
    Visium Xenium STOmics Merfish Custom
    VR Demo

    ROIs can be selected by using the selection tool.

    To select a group of ROIs:

    1. Click on the selection button.
    2. An context menu will appear below.
    3. Choose a group number from 1 to 4.
    4. Click on individual locations in the dataset to add them to the respective group.
    5. Selected locations will be colored according to the chosen group number.

    Remove a single location
    Visium Xenium STOmics Merfish Custom
    VR Demo

    Single locations can be removed from the ROI selection.

    To remove a single location from the ROIs:

    1. In the selection tool context menu use the slider.
    2. Changing the slider value from + to -.
    3. Click on the location that should be removed from the group 1 - 4 selected the selection.
    4. Changing the slider to + again allows adding new locations to the selected group.

    Remove all selections
    Visium Xenium STOmics Merfish Custom
    VR Demo

    All locations can be removed from all groups at once.

    To remove all selections:

    • In the selection tool context menu use the trash button 🗑.
    • This will remove all selections made.

    Export ROI selections
    Visium Xenium STOmics Merfish Custom
    VR

    ROI selections can be exported. This will export all current selected locations and the respective groups they are in for later analysis.

    To export selections:

    • Select ROIs by using the selection tool.
    • Click on the export button (Arrow up).
    • A .txt file will be generated to save the current selections.
    Import ROI selections
    Visium
    VR

    To import previously saved ROI selections:

    • Ensure no locations are currently selected. If unsure use the trash button 🗑.
    • Click on the import button (Arrow down).
    • The last saved selection will be applied
    3D ROI selection
    Visium Xenium STOmics Merfish Custom
    VR Demo

    In VR-Omics, it is possible to make 3D selections of ROIs if a 3D dataset (e.g. multiple Visium slides) is used. To make a 3D selection:

    1. Select the 3D selection tool.
    2. Choose a group number from 1 to 4.
    3. Click on a location in the dataset.
    4. Underlying locations associated with the clicked location will be selected as well.

    This allows the user to select 3D regions of interest. These selections can be exported as described above.

    To toggle between 3D and 2D selection, use the 3D selection button.

    Tissue Overlay Features
    Feature Description Icon Image
    Tissue Overlay
    Visium
    VR

    The dataset can be overlaid with the respective tissue image. Use the tissue button to activate the tissue image overlay. The image is aligned automatically.

    The image will be automatically downloaded if the dataset was downloaded using VR-Omics Automated Workflow.

    If using a different dataset, ensure that the tissue file is called tissue_hires_image.png and saved within the sample folder.

    The tissue image provides additional spatial orientation.

    More information about the tissue alignment can be found in the 10X Genomics Spatial Outputs section.

    Tissue Opacity
    Visium
    VR

    The tissue opacity can be adjusted using the opacity slider in the tissue context menu.

    Move the slider to the left decreased the tissue opacity.

    Move the slider to the right increases the tissue opacity.

    Low tissue image opacity.
    High tissue image opacity.
    Explorative Comparison Features
    Feature Description Icon Image
    Side-by-Side comparison
    Visium Xenium STOmics Merfish Custom
    VR Demo

    The side-by-side comparison feature allows comparing two different gene expression patterns next to each other.

    To enable the feature, click on the "Compare" button in the menu.

    The current dataset will be duplicated.

    Additionally, a slider with the label Duplicate will appear under the search box.

    If the slider is set to left, and a new gene is selected from the search bar, the gene will be applied to the left dataset. If the slider is set to right, the next gene will be applied to the right side of the dataset.

    This feature can be combined with the ROI selection tool, where ROIs will be visualized in both datasets.

    Comparison of two gene expression patterns
    Visium Xenium STOmics Merfish Custom
    VR Demo

    If the side-by-side comparison feature is disabled while two different genes were selected, a dialog menu will open asking to merge or discard the selection.

    If the user decides to merge the selection, a vector based difference analysis is performed.

    The difference between the both genes selected in each location will be calculated and visualised in a heatmap like manner. This allows easily to visualise regions of similarity or high differences.

    Showing spatially variable genes (SVGs) results
    Visium Xenium STOmics Merfish Tomo-Seq Custom
    VR Demo

    If the SVG analysis was performed using the VR-Omics Autoamted Workflow, the Visualiser is able to highlight the SVGs in the search results.

    If a term is entered into the search bar, the autocomplete feature will show the search results for the available genes. The buttons for SVGs will be highlighted in cyan.

    Browse SVG results in the Visualiser
    Visium Xenium STOmics Merfish Tomo-Seq Custom
    VR Demo

    If the SVG analysis was performed using the VR-Omics Autoamted Workflow, the SVG results can be browsed from the Visualiser:

    • From the Top menu select the SVG button.
    • Scroll through the results. The SVG names together with their p- and q-values are shown.
    • Close the window by clicking on the SVG button again.
    Export Features
    Feature Description Icon Image
    Continue Session
    Visium Xenium STOmics Merfish Tomo-Seq Custom
    VR Demo

    Your current session can be saved and continued to a later time point.

    This will include:

    • The current SRT method and dataset.
    • The current camera position.
    • Current selected gene.
    • Selected ROIs

    To save the session select the top menu and click on the Save button.

    To continue a saved session, from the main menu select the Continue Session button

    Keep in mind that saving the current session will override the last session saved. The sessions are saved as json files within the data structure.

    Screenshot
    Visium Xenium STOmics Merfish Tomo-Seq Custom
    VR Demo

    Screenshots can be made from the visualiser. For the screenshot only the dataset will be shown.

    To make a screenshot:

    1. Expand the Top Menu.
    2. Click the screenshot button
    3. The screenshot will be automatically saved locally.
    Export ROI selections
    Visium
    VR

    ROI selections can be exported. This will export all current selected locations and the respective groups they are in for later analysis.

    To export selections:

    • Select ROIs by using the selection tool.
    • Click on the export button (Arrow up).
    • A .txt file will be generated to save the current selections.
    Import ROI selections
    Visium
    VR

    To import previously saved ROI selections:

    • Ensure no locations are currently selected. If unsure use the trash button 🗑.
    • Click on the import button (Arrow down).
    • The last saved selection will be applied
    Output plots
    Visium
    VR

    If the VR-Omics Automated Workflow was used to download the Visium data optionally the output plots can be generated.

    The plots will be saved within the sample folder in the VR-Omics folder ../VR-Omics/Assets/PythonFiles/sample/figures.

    The plots can also be quick accessed from the top menu through the Visualiser

    Sample overview of the spatial plots.
    Switch VR and Desktop Application
    Feature Description Icon Image
    Switching between desktop and VR application
    Visium Xenium STOmics Merfish Tomo-Seq Custom
    VR Demo

    VR-Omics allows to easily switch between the desktop application and the VR environment:

    • Before starting VR-Omics ensure that your VR headset is connected.
    • From the Automated Workflow click the VR button (Icon will change) and then put the headset on.
    • From the Visualiser click the VR button (Icon will change) and then put the headset on.
    • To leave the VR environment click the VR button again and take off the headset.
    • The keyboard can be used in VR to enter text into the search bars

    We used the VR toolkit plugin (XR Interaction Toolkit version 2.0.3) supported are all devices that are supported by the toolkit.

    The following headsets have been confirmed to work with the plugin but not all are tested with VR-Omics: Windows Mixed Reality (eg: HP Reverb, Samsung Odyssey), Oculus Quest & Quest 2, Pimax 5K & 8KX, Varjo Aero & VR-3, Valve Index, HTC Vive, HTC Vive Cosmos, Pico Neo 3 & 4.

    We recommend using the Oculus Quest 2 or Quest Pro

    off

    on

    Additional Parameters to Explore
    Feature Description Icon Image
    Show Cluster information
    Visium Xenium STOmics Merfish Tomo-Seq Custom
    VR Demo

    If cluster information is available it can be visualised in the VR-Omics Visualiser:

    • Expand the top menu in the top center of the screen
    • Click on the Cluster button
    • Each location will be highlighted according to the cluster information found. Locations that are not found in any cluster will become black.
    Access spatial plots
    Visium
    VR

    If spatial plots are available they can be visualised in the VR-Omics Visualiser:

    More information on which plots are available with the VR-Omics Automated Workflow can be found here

    To show the plots in the Visualiser:

    • Expand the top menu in the top center of the screen
    • Click on the Plots button
    • A new window will open showing the available plots.
    • Navigate through the plots using the top menu
    • Close the window by pressing the X button.
    Show all available plots:
    3D Object Alignment
    Feature Description Icon Image
    Change 3D Object Opacity
    Visium Xenium STOmics Merfish Tomo-Seq Custom
    VR Demo

    The opacity of the 3D object can be adjusted:

    • Use the slider on the left side in the menu panel.
    • Adjusting the slider to the left will decrease the opacity of the 3D Object until fully invisible.
    • Adjusting the slider to the right will increase the opacity of the 3D Object until not transparent at all.
    Slider left, the 3D object becomes invisible
    Slider further to the right, the 3D object becomes non transparent.
    Move 3D object
    Visium Xenium STOmics Merfish Tomo-Seq Custom
    VR Demo

    The 3D object can be moved independently from the dataset to align the object:

    • Expand the top menu in the top center of the screen.
    • Click on the 3D Object button.
    • A selection of three additional buttons appears.
    • Click on the move button to unlock movement.
    • Once the move button was pressed the Object can be moved.
      • Up: T
      • Down: G
      • Right: H
      • Left: F
      • Forward: Shift + G
      • Back: Shift + T
    • Lock movement by clicking the move button again.
    Rotate 3D Object
    Visium Xenium STOmics Merfish Tomo-Seq Custom
    VR Demo

    The 3D object can be rotated independently from the dataset to align the object:

    • Expand the top menu in the top center of the screen.
    • Click on the 3D Object button.
    • A selection of three additional buttons appears.
    • Click on the rotate button to unlock rotation.
    • Once the rotate button was pressed the Object can be rotated.
      • Front Up: T
      • Front Down: G
      • Right: H
      • Left: F
      • Side up: Shift + G
      • Side down: Shift + T
    • Lock rotation by clicking the rotate button again.
    Resize 3D Object
    Visium Xenium STOmics Merfish Tomo-Seq Custom
    VR Demo

    The 3D object can be resized independently from the dataset to align the object:

    • Expand the top menu in the top center of the screen.
    • Click on the 3D Object button.
    • A selection of three additional buttons appears.
    • Click on the resize button to unlock the resize feature.
    • Once the resize button was pressed the Object can be resized
      • Increase width: T
      • Decrease width: G
      • Increase height: H
      • Decrease height: F
      • Increase depth: Shift + G
      • Decrease depth: Shift + T
    • Lock the resize feature by clicking the resize button again.
    Customisation
    Feature Description Icon Image
    Change the Symbol
    Visium Xenium STOmics Merfish Tomo-Seq Custom
    VR Demo

    Per default the Symbol to visualise a location is a sphere (except of Tomo-Seq). This can be changed to a Cube:

    • Extend the top menu from the top center of the screen.
    • Click on the change symbol button.
    • The locations will be changed to the selected symbol and the button changes accordingly.
    • Click the new button again to toggle back to the original symbol.
    Symbol changed to Cubes.
    Change the Symbol Size
    Visium Xenium STOmics Merfish Tomo-Seq Custom
    VR Demo

    The symbol size can be changed:

    • From the menu panel on the left use the Size slider to adjust the size of the symbols.
    • Move the slider to the left to make the symbols smaller.
    • Move the slider to the right to increase the symbol size.
    Size
    Small symbols.
    Big symbols.
    Reset the view
    Visium Xenium STOmics Merfish Tomo-Seq Custom
    VR Demo

    To reset the view to the origin click the reset view button in the bottom left of the screen.

    The slide is twisted.
    Clicking the view reset button adjusts the view back to the origin.
    Change Background Colour
    Visium Xenium STOmics Merfish Tomo-Seq Custom
    VR Demo

    The background colour can be changed from dark to bright mode.

    • From the menu panel on the left click on the bright mode button if the background is currently set to black.
    • The background will change to white and the bright button will be replaced with a dark button.
    • To change the colour back to black click the dark button.
    Bright mode - background set to white.
    Address

    Murdoch Children's Research Institute, Parkville, Melbourne

    Email

    denis.bienroth@mcri.edu.au


    Website

    MCRI website

    ©